-- Logs begin at Fri 2022-08-05 19:54:18 UTC, end at Fri 2022-08-05 21:01:08 UTC. -- Aug 05 20:29:49.905215 dv-cinder-852208-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 20:29:49 2022] *** Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: nodename: dv-cinder-852208-3-iscsi Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: machine: x86_64 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: clock source: unix Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: pcre jit disabled Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: detected number of CPU cores: 4 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: current working directory: / Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: detected binary path: /usr/bin/uwsgi-core Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: your processes number limit is 47680 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: your memory page size is 4096 bytes Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: detected max file descriptor number: 2048 Aug 05 20:29:49.919386 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: lock engine: pthread robust mutexes Aug 05 20:29:49.920599 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: thunder lock: enabled Aug 05 20:29:49.920599 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 20:29:49.920599 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 20:29:49.958939 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: Python main interpreter initialized at 0x55c822cd89c0 Aug 05 20:29:49.958939 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: python threads support enabled Aug 05 20:29:49.958939 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: your server socket listen backlog is limited to 100 connections Aug 05 20:29:49.958939 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: your mercy for graceful operations on workers is 90 seconds Aug 05 20:29:49.959388 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 20:29:49.959388 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: *** Operational MODE: preforking *** Aug 05 20:29:49.959658 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: *** uWSGI is running in multiple interpreter mode *** Aug 05 20:29:49.959658 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: spawned uWSGI master process (pid: 80426) Aug 05 20:29:49.959879 dv-cinder-852208-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 05 20:29:49.961026 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: spawned uWSGI worker 1 (pid: 80437, cores: 1) Aug 05 20:29:49.961364 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: spawned uWSGI worker 2 (pid: 80438, cores: 1) Aug 05 20:29:49.961620 dv-cinder-852208-3-iscsi devstack@keystone.service[80426]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 20:29:55.407124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:29:55.407124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: from cryptography.utils import int_from_bytes Aug 05 20:29:55.407942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:29:55.407942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: from cryptography.utils import int_from_bytes Aug 05 20:29:55.408348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:29:55.408348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: from cryptography.utils import int_from_bytes Aug 05 20:29:55.408455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:29:55.408455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: from cryptography.utils import int_from_bytes Aug 05 20:29:55.457501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:29:55.457713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:29:55.457799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:29:55.457871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:29:55.457936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] command line args: [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:29:55.457994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] command line args: [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:29:55.458137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:29:55.458279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:29:55.458363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ================================================================================ {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:29:55.458445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ================================================================================ {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:29:55.458522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] admin_token = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.458582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] admin_token = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.458764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] config_dir = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.458859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] config_dir = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.458924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.458999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.459073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] config_source = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.459184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] config_source = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.459272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] debug = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.459339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] debug = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.459488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.460914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_config_append = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_config_append = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_dir = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_dir = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_file = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_file = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.461920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.462925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.463968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.464878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.100/identity {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.100/identity {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] publish_errors = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] publish_errors = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.465967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] standard_threads = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.466983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] standard_threads = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] use_journal = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] use_json = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.467958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] use_stderr = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] use_journal = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] use_syslog = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] use_json = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] use_stderr = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] use_syslog = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.468671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:29:55.468755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.468868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.468994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.469984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.470881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.471988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.472995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.473897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.474899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.475996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.476897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.477987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.478998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.479912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.480985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.481946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.482970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.483928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.484942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.485944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.486964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.487918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.488912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.489901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.490942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.491907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.external = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.492926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.password = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] auth.token = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.external = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.493983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.password = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.494890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] auth.token = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.495942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.496902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.497983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.498902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.499974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.500988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.501892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.502974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.503918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.504924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.505940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.506972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.507909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.508996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.509887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.510926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.511857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.512889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.513919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.514932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.515995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.516892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.517909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.518922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.519969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.520971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.521983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.522986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.523917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] role.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.524927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] role.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.525903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] role.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.526918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] role.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.527824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.528975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.529969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.530920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.531989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.532884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.533905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.534923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.535903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.536944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.connection = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.537930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.538930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.539994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.connection = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.540908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:29:55.541691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.541801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.542051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.542292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.542540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.542780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.543031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.543326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.543604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.543820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.544076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.544318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:29:55.544493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:29:55.571086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.571318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.571559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.572630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.572870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.573098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.580176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.581680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.609928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.610110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.611489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.611729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.662007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.662451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.711379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.711703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.712397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.712641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.775772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.776957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.777085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.777209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.800917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.801625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.812328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.812898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.825934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.826783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 20:29:55.843279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.843500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 20:29:55.843668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.843885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 20:29:55.844164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 20:29:55.844297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 20:29:55.844643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.844937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.845056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.845137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.845403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.854649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.854925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.855191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.855318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.855492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.855636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.855856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.856083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.862839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.863049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.867582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.867783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.867888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.868966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.869946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.870115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.870246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.870374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.870500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.893348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.893729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.894818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.895095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.895290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.895492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.899721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.899999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.900123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.900287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.900413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.900715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.907802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.908079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.908827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.909119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.912531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.912760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.913036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.913323 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.913593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.913733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.913843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.913930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.914158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.914283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.914379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.914456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.914736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.915028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.915302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.915608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.930489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.930763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.931731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.932016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.934812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.936248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.938044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.938340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.939451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.939746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.942738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.944173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.946024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.947490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.949181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.949568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.949910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.950171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.950440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.950730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.950870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.951010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.951313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.951634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.951914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.952202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.966919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.967204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.967502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.967743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.968398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.968708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.968954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.969220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.974566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.976146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.976273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.976462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.977713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.977993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.979250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.979558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.979871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.980182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.980480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.980936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.981231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.981540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.981814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.982092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.992379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.992655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.992930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.993209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.993483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.993621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:55.993762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.993843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.994017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.994145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.994391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.994674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.994957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:55.995237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.009848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.011266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.013097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.014420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.016070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.017427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.018751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.020063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.020272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.020555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.020836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.021590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.021885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.022172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.027242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.028768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.029097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.030387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.032047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.032337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.032617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.032887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.033391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.033687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.033978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.034570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.041238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.041524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.041799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.042663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.042969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.043281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.048902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.049178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.049457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.049735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 20:29:56.050354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.050913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.051961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.052831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.053106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.053353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.053618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.053892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 20:29:56.085860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c822cd89c0 pid: 80438 (default app) Aug 05 20:29:56.087931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c822cd89c0 pid: 80437 (default app) Aug 05 20:29:56.089237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eebce-aa1e-4d16-ae56-fd079d66138c None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:29:56.089524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eebce-aa1e-4d16-ae56-fd079d66138c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:29:56.089799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eebce-aa1e-4d16-ae56-fd079d66138c None None] PATH_INFO: `/v3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:29:56.094164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 796 bytes} [Fri Aug 5 20:29:56 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:03.893148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:03.893753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:03.893753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:03.898127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1/2] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:03 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:03.904290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:03.904731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:03.904821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:03.976697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: INFO dbcounter [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] Registered counter for database keystone Aug 05 20:30:03.997959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG oslo_db.sqlalchemy.engines [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:30:04.008894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writer thread running {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:30:04.206863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG passlib.handlers.bcrypt [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 20:30:04.207288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG passlib.handlers.bcrypt [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 20:30:04.263254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:04.264923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:04.421073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 2/3] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:03 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 20:30:04.590402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:04.668093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: INFO dbcounter [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] Registered counter for database keystone Aug 05 20:30:04.692200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG oslo_db.sqlalchemy.engines [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:30:04.703019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writer thread running {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:30:04.836882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2615-ee50-4b6f-a8bb-377a9999f093 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:04.842765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:04.843339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:04.843654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:04.843932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:04.853115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:04.906441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 20:30:04.907015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98643b-bc51-4d6b-9884-fd83acecdc5e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:04.917803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 2/4] 10.222.0.100 () {58 vars in 1329 bytes} [Fri Aug 5 20:30:04 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:30:04.926722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:04.941656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bc964-3e5a-4919-85f3-520f3b0fb6c8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:04.948170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:04.949392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:04.949705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:04.949981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] PATH_INFO: `/v3/projects/abb569dd63634bd9bd1193603cb21bb9` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:04.951797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] RBAC: Authorizing `identity:get_project(project_id=abb569dd63634bd9bd1193603cb21bb9)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:05.002628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 20:30:05.002976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac79f8-ee31-44a3-b0a6-9d46c6c2aa8c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:05.007838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 3/5] 10.222.0.100 () {56 vars in 1212 bytes} [Fri Aug 5 20:30:04 2022] GET /identity/v3/projects/abb569dd63634bd9bd1193603cb21bb9 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:06.988593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679c42-9e81-4520-a39f-1e4b8874dc87 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:06.989126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679c42-9e81-4520-a39f-1e4b8874dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:06.989126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679c42-9e81-4520-a39f-1e4b8874dc87 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:06.995833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 3/6] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:06 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:07.001395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:07.001835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:07.001917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:07.023110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:07.024666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:07.033339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 4/7] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:06 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 20:30:07.056538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679c42-9e81-4520-a39f-1e4b8874dc87 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:07.077098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679c42-9e81-4520-a39f-1e4b8874dc87 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:07.083396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:07.084292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:07.084653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:07.085031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:07.098895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:07.101786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76c713-f675-4c9c-a3f2-f45c8c588b14 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:07.113369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 4/8] 10.222.0.100 () {58 vars in 1329 bytes} [Fri Aug 5 20:30:07 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:30:07.122163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:07.137108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936998-948a-4b3f-b99b-aae52c4329af None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:07.142119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:07.142770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:07.143055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:07.143344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:07.144880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:07.146759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd70348-2fa7-4a8b-8232-7964269b0e9b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:07.148370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 5/9] 10.222.0.100 () {56 vars in 1203 bytes} [Fri Aug 5 20:30:07 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:09.259747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8209-e593-4db1-ae40-4357502bfd82 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.260267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8209-e593-4db1-ae40-4357502bfd82 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.260267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8209-e593-4db1-ae40-4357502bfd82 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.261583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 5/10] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:09.266905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.267340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.267480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.288472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:09.289678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:09.326848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ae1e-cd99-4bdc-9320-b37e1d898d5c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.327142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ae1e-cd99-4bdc-9320-b37e1d898d5c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.327471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ae1e-cd99-4bdc-9320-b37e1d898d5c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.328840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 6/11] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:09.333694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.333986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.334267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.374630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 6/12] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:09.377554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG passlib.handlers.bcrypt [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80437) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 20:30:09.377985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG passlib.handlers.bcrypt [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80437) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 20:30:09.396229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.422427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:09.423805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:09.425493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:09.503597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c99f1-a1b1-4837-8d76-09372c954f38 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:09.530764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 7/13] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:09.539969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:09.540611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.540894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.541172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.553610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.608816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:09.610453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:09.635071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:09.655538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59eeb5-d72c-4fd4-9e1e-9403f35edf0e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:09.658260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:09.693551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:09.694679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.694968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.695249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.707105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:09.712663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 7/14] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:09.716337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:09.717287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:09.721291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 8/15] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:09.722110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.724070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.821035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7149997-d0ad-4526-8bef-5c795caf187b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:09.825833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52027cc2-1dcd-476f-8e6e-137ed4c90b4b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:09.844330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:09.856241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:09.856906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.857192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.857473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.861341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:09.861975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:09.862261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:09.862536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:09.863264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:09.863598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:09.865097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:09.867622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:09.869089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:09.877055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 9/16] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:09.882670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:30:09.888780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:09.889806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:09.890606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:30:09.890606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:30:09.890606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:30:09.890606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:09.890606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 8/17] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:09.895854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:09.913096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:10.004309 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dbf1c-6ab8-4c57-8abe-75fda3155763 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:10.042958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:10.043742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:10.044025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:10.044300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:10.045864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:10.047336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:10.048966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 10/18] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:10.054608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:10.111075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22e848-3515-48fb-ac06-f8686b581eb4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:10.145998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:10.146631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:10.146916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:10.147192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:10.147929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:10.148234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:10.149629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:10.154147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:10.161936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0478-9c8d-4368-9e1b-151f6c43b603 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:10.167557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 9/19] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:30:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:10.198283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:10.198991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:10.199248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:10.199604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:10.201621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:10.203136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbdf39-7181-41e6-af97-be9ef1e5559e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:10.205069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 11/20] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:10.211175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:10.251575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:10.328763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b6c-d62a-41a0-b0f1-4348e81a325f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:10.365310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:10.365895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:10.366170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:10.366452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:10.367262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.domain.id=default, user.id=08fbb9e763104d83ac22d69bcd83fff2) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:10.367608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:10.369080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ef612-dad9-41cd-ad7c-e7924e6da564 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:10.376391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 10/21] 10.222.0.100 () {56 vars in 1327 bytes} [Fri Aug 5 20:30:10 2022] GET /identity/v3/role_assignments?user.id=08fbb9e763104d83ac22d69bcd83fff2&scope.domain.id=default&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 234 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:12.862171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8d51-361e-4a02-ba91-e7e67f1b5ad8 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:12.862673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8d51-361e-4a02-ba91-e7e67f1b5ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:12.862743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a8d51-361e-4a02-ba91-e7e67f1b5ad8 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:12.864105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 12/22] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:12.869719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26667-11cb-4fc7-9a07-c611766d4e03 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:12.870570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26667-11cb-4fc7-9a07-c611766d4e03 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:12.871033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26667-11cb-4fc7-9a07-c611766d4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:12.908483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-60b26667-11cb-4fc7-9a07-c611766d4e03 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:12.910329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-60b26667-11cb-4fc7-9a07-c611766d4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:12.947667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df57f7-9c0c-4321-9411-037d9bb3126d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:12.948230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df57f7-9c0c-4321-9411-037d9bb3126d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:12.948702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df57f7-9c0c-4321-9411-037d9bb3126d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:12.950305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 13/23] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:12.955578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:12.956101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:12.956569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.016501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:13.018133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:13.085962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 11/24] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:13.100925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cc369-fa4f-4fdb-89c7-a4e7d7955f15 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.101503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cc369-fa4f-4fdb-89c7-a4e7d7955f15 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.101958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cc369-fa4f-4fdb-89c7-a4e7d7955f15 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.107805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 12/25] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:13 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:13.118755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.119305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.119805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.137349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 14/26] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:13.138955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:13.165721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:13.167151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:13.193514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:13.289853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 13/27] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:13.292862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:13.372593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:13.395118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3d6a-4b82-4b6c-9064-d24ecbcd0e60 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:13.484457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:13.485376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.485793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.486196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.532488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:13.538284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb22182-400a-4d1c-a42c-824e59d7c3a6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:13.538614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:30:13.580298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:13.581176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:13.581951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:30:13.581951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:30:13.581951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:30:13.581951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:13.581951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 15/28] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:13.582916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:13.627131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:13.630500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.632282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.633799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.689508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-07a23852-fbe8-46cc-8d75-7669f24b0aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:13.715634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:13.716525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:13.717286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:13.722694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 14/29] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:13.722694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee00d8-4e0b-466d-964d-3e7cb78b6405 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.722694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee00d8-4e0b-466d-964d-3e7cb78b6405 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.722694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee00d8-4e0b-466d-964d-3e7cb78b6405 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.723299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 15/30] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:13.724170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee00d8-4e0b-466d-964d-3e7cb78b6405 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:13.806677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:13.825060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1df00-4453-41d0-b780-d0799ec0286b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:13.960885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:13.960885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:13.960885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:13.960885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:13.965640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:13.966745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daff87-9074-4d37-ad23-f872b60ab99a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.075589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee00d8-4e0b-466d-964d-3e7cb78b6405 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.116697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.117524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.117911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.118281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.119119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:14.119575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.121112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.139468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 16/31] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:30:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:14.139468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.227933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.252786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699334c-255e-4a75-a7d5-73ef97f7f198 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.285130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 16/32] 10.222.0.100 () {60 vars in 1136 bytes} [Fri Aug 5 20:30:13 2022] POST /identity/v3/roles => generated 220 bytes in 703 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:14.286793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604946c-80f0-417c-8eb1-0a63ec0363e9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.287026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604946c-80f0-417c-8eb1-0a63ec0363e9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.287317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604946c-80f0-417c-8eb1-0a63ec0363e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.291659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.292744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.293491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.294101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.295378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:14.295740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.296161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.299257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.312238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9604946c-80f0-417c-8eb1-0a63ec0363e9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:14.313911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9604946c-80f0-417c-8eb1-0a63ec0363e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:14.316531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 17/33] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:14.317379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.396855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 17/34] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:14.398191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c52d1-1d61-4ddf-aade-fb4ac06b035c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.398487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c52d1-1d61-4ddf-aade-fb4ac06b035c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.398775 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c52d1-1d61-4ddf-aade-fb4ac06b035c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.400129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 18/35] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:14.407503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd81fc-854e-485a-8e75-462ae698037b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.407503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd81fc-854e-485a-8e75-462ae698037b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.407503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd81fc-854e-485a-8e75-462ae698037b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.407503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 19/36] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:14.407503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd81fc-854e-485a-8e75-462ae698037b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.470871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4301-3132-4896-9037-0c7fb776afc1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.510754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.511321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.511647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.511976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.512673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.514140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137a80a-e74b-472a-b5ab-120216329746 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.525253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd81fc-854e-485a-8e75-462ae698037b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.525757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.563211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.563910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.564203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.564490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.565779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.567447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d569d-22db-4426-91b2-5955888603e6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.569144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 20/37] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:14 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:14.570314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.570605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.570880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.577485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.590413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:14.591723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:14.666258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 18/38] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/projects => generated 302 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:14.667744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.668036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.668455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.675455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 21/39] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:14.676371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.698708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:14.700946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:14.780954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 19/40] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:14.781879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.820813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cd61e-e8ca-4390-bb2e-a2b5d1c284d1 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.859086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.868505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.869163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.869453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.869765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.870502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.872258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.889416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 22/41] 10.222.0.100 () {60 vars in 1136 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/roles => generated 226 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:14.890260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:14.903442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7770ef-2d66-44ae-afa9-7e02389a0eab None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:14.935576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:14.952512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:14.953197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:14.953490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:14.954160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:14.955016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:14.959211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:14.960102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 20/42] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:14 2022] GET /identity/v3/domains/default => generated 200 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:14.967171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:15.016555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bdf8-22d4-4939-a8dc-b58ccd8662ea None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:15.052887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:15.053890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:15.054179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:15.054463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:15.056065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:15.057558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:15.059422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 23/43] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:14 2022] GET /identity/v3/domains/default => generated 200 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:15.063454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:15.095486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5197-678b-49e3-90ac-fec151853682 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:15.128270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:15.128908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:15.129206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:15.129466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:15.130188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:15.131622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:15.133981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:15.148204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 21/44] 10.222.0.100 () {60 vars in 1136 bytes} [Fri Aug 5 20:30:14 2022] POST /identity/v3/roles => generated 224 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:15.148994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:15.195257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda059-2de7-4c4a-97a6-e4fb37ff2e84 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:15.204082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:15.240003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:15.241364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:15.241661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:15.242336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] PATH_INFO: `/v3/domains/default/users/08fbb9e763104d83ac22d69bcd83fff2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:15.245033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=08fbb9e763104d83ac22d69bcd83fff2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:15.247743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b71a-6143-4437-b8b3-6164b4e53b55 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:15.265160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 24/45] 10.222.0.100 () {58 vars in 1366 bytes} [Fri Aug 5 20:30:15 2022] PUT /identity/v3/domains/default/users/08fbb9e763104d83ac22d69bcd83fff2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:15.266235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c36c-de68-49b4-bf3e-94cb211a3de7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:15.314614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:15.315187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:15.315515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:15.315807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:15.316518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:15.318054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163efa92-7f85-4862-ac40-78d655927b62 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:15.351268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 22/46] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:30:15 2022] POST /identity/v3/projects => generated 313 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:17.277357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51375b6-a3db-4e5c-a0ec-d463d6c8a988 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.278003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51375b6-a3db-4e5c-a0ec-d463d6c8a988 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.278003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51375b6-a3db-4e5c-a0ec-d463d6c8a988 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.279420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 25/47] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:17.285699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.286174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.286285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.305784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:17.307036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:17.356268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d3875-5bf0-47c2-9a8c-387070300e5b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.356654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d3875-5bf0-47c2-9a8c-387070300e5b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.356945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d3875-5bf0-47c2-9a8c-387070300e5b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.358298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 26/48] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:17.363247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.363636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.363926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.379584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 23/49] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:17.382223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:17.383490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:17.401815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:17.432970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:17.455151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 27/50] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:17.478035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:17.504108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25512d-0974-4885-a024-4122c3dbefcb None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:17.526389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:17.539592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:17.540191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.540477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.540754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.551156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:17.556146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:17.556950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:17.557865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 24/51] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:17.563427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:17.579214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8f68-f6be-40a1-95dc-15eb12a16203 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:17.615046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:17.615849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.616212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.616692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.617886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:17.619621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:17.621440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 28/52] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:17.627819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:17.662579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:17.672069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1935-b7c2-4cd1-b5b4-47c04b0004ad None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:17.705692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:17.706329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.706616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.706896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.707658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:17.707976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:17.709387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:17.717942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 25/53] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:17.723494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:17.733876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26e15f-c746-4107-bedf-64c2194c9638 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:17.752077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:17.770041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:17.770700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.770994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.771276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.772042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:17.773534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:17.803689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 29/54] 10.222.0.100 () {60 vars in 1145 bytes} [Fri Aug 5 20:30:17 2022] POST /identity/v3/projects => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:17.839556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a70c-f0ff-430e-a872-01162ebe9641 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:17.879382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:17.880058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:17.880347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:17.880626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:17.881909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:17.883423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:17.885155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 26/55] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:17 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:17.891703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:18.003873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507866-b3f3-435d-8b66-3a55b309b744 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:18.038053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:18.038715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:18.039008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:18.039277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:18.040466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:18.041951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3e4f-242d-4a47-8ffd-dc113f88e261 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:18.043666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 30/56] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:18.049517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:18.077244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:18.156644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ed1d-5d28-4ba4-9aa1-a8117c25113c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:18.193060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:18.193689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:18.193974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:18.194254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:18.195065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.domain.id=default, user.id=08fbb9e763104d83ac22d69bcd83fff2) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:18.195382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:18.196888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ad09-8f98-4014-b326-7bb85ff39a7f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:18.203154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 27/57] 10.222.0.100 () {56 vars in 1327 bytes} [Fri Aug 5 20:30:18 2022] GET /identity/v3/role_assignments?user.id=08fbb9e763104d83ac22d69bcd83fff2&scope.domain.id=default&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 532 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:19.805977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f4e0-7281-44ba-a6a6-104eca3d664a None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:19.806767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f4e0-7281-44ba-a6a6-104eca3d664a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:19.806876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f4e0-7281-44ba-a6a6-104eca3d664a None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:19.810064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 31/58] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:19 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:19.815499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:19.815916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:19.816019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:19.836952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:19.838145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:19.912467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 28/59] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:19.936767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f4e0-7281-44ba-a6a6-104eca3d664a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:19.983156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:20.049501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f4e0-7281-44ba-a6a6-104eca3d664a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:20.086428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:20.087025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:20.087318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:20.087623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:20.088910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:20.090451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a307eb-7621-46ed-9652-a9aa4a4cfdec None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:20.092183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 32/60] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:20.098119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:20.116693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:20.209251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b9e67-ef06-4b72-ab81-3d336d7b9ef0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:20.249772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:20.250399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:20.250687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:20.250967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:20.251698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:20.253172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f9be-e7d0-4d91-8d11-a52adfe59b1c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:20.282058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 29/61] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:20 2022] POST /identity/v3/users => generated 276 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:23.451071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4b0ee-c8af-49e5-b669-e0eead0b5dd4 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.451611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4b0ee-c8af-49e5-b669-e0eead0b5dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.451685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4b0ee-c8af-49e5-b669-e0eead0b5dd4 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.453007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 33/62] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:23.459406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.459406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.459406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.486058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:23.487267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:23.506290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462f2f-5191-40b1-a8cf-2362b93033fd None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.506575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462f2f-5191-40b1-a8cf-2362b93033fd None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.507036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462f2f-5191-40b1-a8cf-2362b93033fd None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.508555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 34/63] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:23.513998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.514445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.514858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.546219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:23.547464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:23.581844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 30/64] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:23.608546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:23.639768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:23.665092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 35/65] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:23.697079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:23.734596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2791-fbcb-4c8e-8646-2abe76dc8afe None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:23.752552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:23.774438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:23.776135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.776759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.777307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.792770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-75952e00-741f-43bf-9c03-dbab58dd9b86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:23.802887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:23.803816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:23.804631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:23.807138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 31/66] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:23.808906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb4e-1f82-43c9-a912-8993afef4f9b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.809826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb4e-1f82-43c9-a912-8993afef4f9b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.810117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb4e-1f82-43c9-a912-8993afef4f9b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.811419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 32/67] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:23.816426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3bb4e-1f82-43c9-a912-8993afef4f9b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:23.832582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5df0e4-ec7e-4a53-a519-af9ca53a6416 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:23.874669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:23.875599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.876090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.876498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.887707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-bdc4132b-9c02-4a3e-ba86-ff3657598b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:23.892878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:23.893678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:23.894425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:23.896787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 36/68] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:23.898746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:23.899232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:23.899736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:23.900238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:23.924240 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:23.925457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:23.951503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3bb4e-1f82-43c9-a912-8993afef4f9b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.001759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.002571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.003014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.003662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.005066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:24.005651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.007999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.019318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 33/69] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:24.020394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.025764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 37/70] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:24.026854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.076638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.141404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad849686-0c05-455a-befb-ac4057592fdd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.164180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a050c98-a480-4064-bf61-5d2ea377a3e8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.167700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.181320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.181959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.182250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.182536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.183274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:24.183619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.185229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.193322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 34/71] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:24.194105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.201163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.201832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.202119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.202402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.218852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.220394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7e8cc-50c6-4b8d-972d-df65e8a6938c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.222110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 38/72] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:24.223298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a5fc-09de-4562-82cd-c633427a0934 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.223616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a5fc-09de-4562-82cd-c633427a0934 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.223900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a5fc-09de-4562-82cd-c633427a0934 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.225091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 39/73] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:24 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:24.226127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432393-befe-4c68-a8aa-efee440a9612 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.226417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432393-befe-4c68-a8aa-efee440a9612 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.226783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432393-befe-4c68-a8aa-efee440a9612 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.227988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 40/74] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:24 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:24.228698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432393-befe-4c68-a8aa-efee440a9612 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.308893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c83e-0e2d-40ab-863c-4300d5f6ee88 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.318167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.336083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432393-befe-4c68-a8aa-efee440a9612 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.343710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.344372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.344658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.344938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.355458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:24.361069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:24.361922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:24.362654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 35/75] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:24.363276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.372223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.372886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.373175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.373456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.374649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.376171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2c9de-0bbd-441a-bbb8-d04ea18f7ec6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.377795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 41/76] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:24.378911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3b953-d159-45d5-807c-63e97d6b082c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.379202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3b953-d159-45d5-807c-63e97d6b082c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.379513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3b953-d159-45d5-807c-63e97d6b082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.397681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-72f3b953-d159-45d5-807c-63e97d6b082c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:24.398897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-72f3b953-d159-45d5-807c-63e97d6b082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:24.417130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.469861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 42/77] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:24.471251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.471577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.471863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.479502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b149b2-a36e-4d05-b1ba-01eaae835791 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.493730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:24.494941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:24.515487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.516130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.516421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.516706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.565110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 43/78] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:24.565905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.581033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.592684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.594192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.639566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.670228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faa3fa-73a7-424a-9790-74d42f2d75f2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.693904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 36/79] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:24.694759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.708789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.709439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.709725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.710008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.710746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:24.711059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.712494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.721046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 44/80] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:24.725901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.804491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.805715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc8a1d-95cc-4e9c-8896-df23ac66f956 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.830748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0abbd-8f91-4462-8d3f-2eea6707d5d7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:24.842543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.843177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.843497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.843775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.859958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:24.864951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:24.865608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:24.865897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:24.866175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:24.878727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:24.884085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:24.885061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:24.885821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 45/81] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:24.886439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:24.915639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:24.917284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:24.994442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327066ac-0546-426f-b785-0ed577e5812f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.021470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 37/82] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:25.024215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.027871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.028539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.028826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.029104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.030276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.031779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.033385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 46/83] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:24 2022] GET /identity/v3/domains/default => generated 200 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.034145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.037672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.071965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.125587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf1b2a-1b72-49f3-b17e-c5ec818ada0b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.139638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64a6fe-1949-4c25-8657-ea00f25864c8 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.161341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.161985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.162283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.162563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.163824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.165319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.167162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 38/84] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.167801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.178223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.178876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.179399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.179503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.180632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.182073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.183811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 47/85] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.184765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.255240 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.266396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d085-f737-4350-a8c2-56a2f7449a17 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.280689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.289249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aa8e-5e4e-4731-b035-8eacb6b2db7d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.303883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.304521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.304807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.305090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.305828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:25.306140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.307561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.316051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 39/86] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.316832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.323274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.323971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.324243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.324593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.325819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.327275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.328948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 48/87] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.329704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.418083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c691d-bfc9-4de1-b68f-c8cfc12cd907 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.427912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041037ff-348d-4bed-98bf-1f3568343958 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.452054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.452680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.452975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.453256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.453954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.455445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.462155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.462785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.463076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.463392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.464185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:25.464503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.466597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.474850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 49/88] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.476319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.484055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 40/89] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:25 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:25.484055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.486536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.534242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.642139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b490826-c0dc-4522-810d-9f5dea85fdb9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.664397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84470-a64d-49d4-99fb-c220566dd217 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.689648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.690350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.690638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.690920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.692153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.693860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.695693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 41/90] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.701737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.707036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.707728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.708019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.708376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.798724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.800305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.802426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.849621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:25.859059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e49ea-3511-4831-947e-43da813afcdd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:25.904309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:25.905620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:25.906126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:25.906591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:25.908728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=08fbb9e763104d83ac22d69bcd83fff2) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:25.909268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:25.911264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:25.923396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 42/91] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/role_assignments?user.id=08fbb9e763104d83ac22d69bcd83fff2&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:25.923396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:25.976586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 50/92] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:25.985551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:26.121049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0aef-b565-4ed9-bf21-4e40552109d2 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:26.193827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:26.194477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:26.194766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:26.195049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:26.212937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a48181-def3-456f-bc84-932049ace3c1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:26.214625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:26.256964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:26.280973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:26.281657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:26.281944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:26.282221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:26.284336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:26.286119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:26.288163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 51/93] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:26.294358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:26.340025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:26.341694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:26.499718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 43/94] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:26.508793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:26.576110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:26.585637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf30f-137b-499e-b841-4a9d01f7a8aa None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:26.618851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5f7a-3b94-4837-84c3-fcaa7fa66f1a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:26.656827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:26.657490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:26.657779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:26.658061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] PATH_INFO: `/v3/projects/ffd72b38621140d3b0c995951e3a152b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:26.659256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd72b38621140d3b0c995951e3a152b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:26.661084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:26.663039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 44/95] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:26 2022] GET /identity/v3/projects/ffd72b38621140d3b0c995951e3a152b => generated 313 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:26.668730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:26.705121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:26.705766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:26.706050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:26.706322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:26.707125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:26.707457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:26.708904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68fa89-56a6-4cfd-a7ee-3fa11b7a0873 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:26.726211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 52/96] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:26 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 260 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:26.784129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1953a3d-5bd3-48b7-a829-40f1b690e4a0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:26.822207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:26.822853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:26.823146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:26.823459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:26.824325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=ffd72b38621140d3b0c995951e3a152b, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:26.824700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:26.826355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7f59-73a5-4681-861a-6c90435ec37c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:26.828803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:26.838068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 45/97] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:26 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=ffd72b38621140d3b0c995951e3a152b&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:28.132938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5cde-0561-4128-924c-5c9559a60c90 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:28.133437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5cde-0561-4128-924c-5c9559a60c90 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:28.133509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5cde-0561-4128-924c-5c9559a60c90 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:28.135424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 53/98] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:28.153182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918820a-7c08-47b2-a5af-2425b60150bf None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:28.153668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918820a-7c08-47b2-a5af-2425b60150bf None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:28.153753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918820a-7c08-47b2-a5af-2425b60150bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:28.177649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b918820a-7c08-47b2-a5af-2425b60150bf None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:28.178867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b918820a-7c08-47b2-a5af-2425b60150bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:28.277164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 46/99] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:28.311328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b5cde-0561-4128-924c-5c9559a60c90 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:28.392082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:28.501036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebb64-b266-49f2-848e-289a126a6fa2 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:28.501366 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebb64-b266-49f2-848e-289a126a6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:28.501937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebb64-b266-49f2-848e-289a126a6fa2 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:28.502995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 47/100] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:28.512915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:28.513205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:28.513505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:28.560888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b5cde-0561-4128-924c-5c9559a60c90 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:28.561555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:28.562779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:28.693128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:28.696644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:28.696644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:28.696644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:28.696894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 48/101] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:28.728422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:28.729373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:28.734063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:28.734917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:28.735776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 54/102] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:28.742849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:28.811330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:28.913878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:28.915754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645bc9d-fc2e-41c5-bf86-243b65ec158c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:28.926505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae446-4fd1-4659-89bc-084d96e02712 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.009138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.009801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.010085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.011389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.011389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:29.011563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.013424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.017233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.017928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.018216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.018494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.035428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 55/103] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.037629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:29.049765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:29.050638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:29.051431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 49/104] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:29.052781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.064452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.267390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06fa3d-53f5-4857-b4fe-1a5743a08b8c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.296080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20186a-3745-4a63-8f4c-2772ed136d9c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.323459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:29.359384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.359384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.359384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.359384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.360517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.362058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42b4b-fb25-41b5-b78f-d7c0ad474711 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.364564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 56/105] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.365324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ec52-d1d9-493c-97f7-2282a900a853 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.365914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ec52-d1d9-493c-97f7-2282a900a853 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.366427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ec52-d1d9-493c-97f7-2282a900a853 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.368814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 57/106] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:29.378054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.378699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.378985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.379263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.380041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:29.380352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.387380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.387380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.387380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.387636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.404738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 50/107] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.405701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.427417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:29.428279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:29.465312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:29.571388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 58/108] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:29.571388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.597545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9fc1-6d0f-4c63-b297-5bccc773822a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.672876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.673555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.673844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.674133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.675938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.677504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998a795-af2b-479d-bbd4-e0be84b9db21 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.679212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 51/109] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.681644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19c00-8f49-4fb5-b471-0127dc7b84e8 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.681771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19c00-8f49-4fb5-b471-0127dc7b84e8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.682034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19c00-8f49-4fb5-b471-0127dc7b84e8 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.688016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 52/110] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:29.688016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19c00-8f49-4fb5-b471-0127dc7b84e8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.751903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16d74-4359-47ef-9594-a56c8e2653ae None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.790120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:29.830792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.831490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.831779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.832057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] PATH_INFO: `/v3/users/b6e951d6d5d94c83982a69e1cf2578dc` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.856111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e951d6d5d94c83982a69e1cf2578dc)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.858355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e634f3-97a4-46d2-a383-a0d30062f137 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.860641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 59/111] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/users/b6e951d6d5d94c83982a69e1cf2578dc => generated 290 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.862152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.862652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.863127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.883499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:29.885355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:29.898862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:29.900312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19c00-8f49-4fb5-b471-0127dc7b84e8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:29.966581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:29.967277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:29.967594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:29.968035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:29.969223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:29.970955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:29.977495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 53/112] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:29.977495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:29.995489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 60/113] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:29.997388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.118096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916c26-5b9a-4fab-a748-ab099a5b573a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:30.120818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0c1b5-a2d5-4126-aadd-73e5bb94b381 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:30.132644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.155349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:30.156083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.156361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.156633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b5638f33a9624f84876f38d01842977b/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.158579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, user_id=b5638f33a9624f84876f38d01842977b, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:30.160391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:30.160641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:30.161283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.161571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.161850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.176633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.178134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 54/114] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:29 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b5638f33a9624f84876f38d01842977b/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:30.187705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.254784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:30.256819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31f79-6d0a-47d7-96df-3ed7875a17a0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:30.325085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7c9ab-b6a6-406f-b3a6-0bb76121f177 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:30.379575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:30.380178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.380462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.380738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.381443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:30.383120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:30.404495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 61/115] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:30.411922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c2a3-84b0-4a85-a491-88872fc68f68 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.412487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c2a3-84b0-4a85-a491-88872fc68f68 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.413243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c2a3-84b0-4a85-a491-88872fc68f68 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.419032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 55/116] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:30:30 2022] POST /identity/v3/projects => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:30.419032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.419910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 62/117] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:30 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:30.421460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0da14-e572-4b49-864a-4cab3ffba14b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.421940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0da14-e572-4b49-864a-4cab3ffba14b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.422407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0da14-e572-4b49-864a-4cab3ffba14b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.424232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 63/118] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:30.425200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0da14-e572-4b49-864a-4cab3ffba14b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.468816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.529029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.599966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87baa2-5282-4ea2-9163-21f1514217fa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:30.635567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0da14-e572-4b49-864a-4cab3ffba14b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:30.659758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:30.661877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.661877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.661877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.680439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7f4b83c8-901f-4150-afaa-bfce6e8672df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:30.687469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:30.688381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:30.689152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:30.691496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 56/119] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:30.694003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:30.694697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.694982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.695258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.696464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:30.697779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.697966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9b5e-fbe7-451a-a4cb-b3356e1394b4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:30.698057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.698346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.703542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 64/120] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:30 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:30.703542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:30.703542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:30.703542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:30.726418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:30.728083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:30.730568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:30.732220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:30.830502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 65/121] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:30.835269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.839500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 57/122] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:30.844316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:30.887195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.916750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:30.996491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8301-411a-40b2-a610-d59c7c119bfb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.026239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d9e7-5862-4418-8d73-4098bb29ba19 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.046200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.049986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.050545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.051114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.052188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:31.054422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:31.056185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:31.068422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 66/123] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:31.069539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.075374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.076055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.076491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.076647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.077418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b6e951d6d5d94c83982a69e1cf2578dc) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:31.077731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:31.079209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:31.086094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 58/124] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:30 2022] GET /identity/v3/role_assignments?user.id=b6e951d6d5d94c83982a69e1cf2578dc&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=5f4e804b30934e05a351efd607f4627a => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:31.091589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.204739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:31.223917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800567d7-63dd-4f5d-aa36-e0f1d8729507 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.291165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.291876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.292159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.292432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.313135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:31.324011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6f97-cba2-4d39-8e62-7c127a5711ef None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:31.325969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:31.327140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:31.327970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:31.328526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 59/125] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:31.330228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.335631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:31.395600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.396254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.398096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.398623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.431905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:31.447951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:31.448851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:31.449668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:31.452222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 67/126] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:31.453369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.481530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc598-1fc9-4adf-aadd-a1d4736e6e1f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.523140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.524202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.524489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.525988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.528904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:31.530596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:31.540630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 60/127] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:31.543383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.564221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:31.688641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b27-d54d-4b91-9fff-12bac4943919 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.752228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd8ca-4b2e-40dd-84af-fa62990ab762 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:31.757449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.758102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.758389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.758669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.759431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:31.770788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:31.770788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:31.785329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 68/128] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:31.786200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.825005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:31.825821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:31.826104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:31.826471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:31.827521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:31.827833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:31.831511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:31.843957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:31.850019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 61/129] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:31.853113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:31.996831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:32.008493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ed0d8-f207-4a24-b132-e5de351384c1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.035660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286b878-e107-483c-9d1f-708a74144167 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.079723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.080390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.080678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.080961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.085379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.087903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.092133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 69/130] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:32.098121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.108073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.108741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.109025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.109305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.110743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.112308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.113949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 62/131] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:31 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:32.122238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.303570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:32.313377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdb47-70f6-428b-b210-08ed9587b8a7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.324161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c4c6-61ac-46ab-aab7-7c479cf39595 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.391308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.393973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.394269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.394553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.399402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.399402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.399402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 70/132] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:32 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:32.400579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.416175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.416895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.417181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.417459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/08fbb9e763104d83ac22d69bcd83fff2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.424194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, user_id=08fbb9e763104d83ac22d69bcd83fff2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.425696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.446881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:32.463387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 63/133] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:32 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/08fbb9e763104d83ac22d69bcd83fff2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:32.463387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.607538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ec9d2-b119-4ae4-8ddb-716e8d6d47ea None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.648764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb597aa-d313-40c3-8071-15a0885bdd80 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.678487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.680474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.680474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.680474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.681537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.685639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b7156-8f3a-4cd5-9911-395a223af36a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.690236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 71/134] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:32 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:32.696635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90004-743c-4205-b0a8-b41349bde9cc None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.700821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90004-743c-4205-b0a8-b41349bde9cc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.700821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90004-743c-4205-b0a8-b41349bde9cc None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.703736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 72/135] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:32 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:32.707068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90004-743c-4205-b0a8-b41349bde9cc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.724946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:32.725915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.726776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.727260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] PATH_INFO: `/v3/projects/ffd72b38621140d3b0c995951e3a152b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.729042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd72b38621140d3b0c995951e3a152b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:32.730968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63848-3524-42ae-82b9-296c1c932206 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:32.733710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 64/136] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:32 2022] GET /identity/v3/projects/ffd72b38621140d3b0c995951e3a152b => generated 313 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:32.736650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:32.737231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:32.737871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:32.783341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:32.784598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:32.795385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:32.859068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:32.873568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 65/137] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:32.874353 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:32.945985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90004-743c-4205-b0a8-b41349bde9cc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:32.991482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fcbca-5f32-4e4e-8e62-af0d319df2d5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:33.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.026492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b5638f33a9624f84876f38d01842977b/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.032643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, user_id=b5638f33a9624f84876f38d01842977b, role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:33.035766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963c47e-27c4-4bad-a948-4767c700e38d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:33.039381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.039381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.039381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.041936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] PATH_INFO: `/v3/projects/ffd72b38621140d3b0c995951e3a152b/users/b5638f33a9624f84876f38d01842977b/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.045498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffd72b38621140d3b0c995951e3a152b, user_id=b5638f33a9624f84876f38d01842977b, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:33.047163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c757fa1-aa79-431e-a12e-074a6dbe3c46 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:33.061947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 73/138] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:32 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b5638f33a9624f84876f38d01842977b/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:33.072230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966122a-ef06-499b-8c8c-708384ac85da None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.075641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966122a-ef06-499b-8c8c-708384ac85da None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.077241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966122a-ef06-499b-8c8c-708384ac85da None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.082041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 74/139] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:33 2022] GET /identity => generated 271 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:33.087930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966122a-ef06-499b-8c8c-708384ac85da None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:33.093294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 66/140] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:32 2022] PUT /identity/v3/projects/ffd72b38621140d3b0c995951e3a152b/users/b5638f33a9624f84876f38d01842977b/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:33.097800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.097800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.100313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.147046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:33.148203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:33.299550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:33.328011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:33.331730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 67/141] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:33.345684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966122a-ef06-499b-8c8c-708384ac85da None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:33.375920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:33.421028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.421719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.421925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.422211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.448800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:33.454346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:33.455233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:33.456039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:33.460724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 75/142] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:33.475329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:33.566001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1b2cf-d6b3-4f2c-aed3-c8b4aa1c56af None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:33.615391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.615391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.615391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.615736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.617312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:33.618639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:33.626301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 68/143] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:33.632894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:33.639671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830d23-69cb-4345-8eb4-018444e273e2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:33.689865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.690446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.690784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.691069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.691849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:33.692163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:33.694700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:33.714396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 76/144] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:33.720280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:33.745107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:33.752109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:33.852579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76b6d-4a1a-4e40-ba40-fcc83b8fdcf7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:33.940780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:33.941363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:33.941647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:33.941918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:33.942621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:33.944109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cab9c-1c54-47cd-ad09-7cfc70a148cf None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:34.002925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e7-78d2-4b74-bb29-2193964201de None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:34.008092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 69/145] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:33 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:34.009496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb154d-0131-4c47-9815-629d7ed7c1c7 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:34.009774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb154d-0131-4c47-9815-629d7ed7c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:34.010046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb154d-0131-4c47-9815-629d7ed7c1c7 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:34.015546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 70/146] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:34.030005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:34.030286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:34.030562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:34.082170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:34.083385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:34.145171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:34.145849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:34.146131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:34.146407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:34.147753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:34.149195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:34.152342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 77/147] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:33 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:34.168709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:34.300331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 71/148] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:34.352059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:34.448816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:34.461308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:34.509423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f0a9-f879-470a-bbc8-3fce3a6c14f2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:34.600880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687b40-20b2-414a-bd7d-44cd836ed950 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:34.604201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:34.605019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:34.605466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:34.606102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:34.692122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:34.693113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:34.693550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:34.693979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:34.716221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:34.726617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:34.727547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:34.728349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:34.732834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 72/149] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:34.752631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:34.754620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:34.768228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:34.918319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:34.951048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 78/150] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:34.959883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:34.999232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7302393-9a8c-4d75-9247-bfef77bc7325 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:35.012397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:35.091391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:35.091391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.091391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.091391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.091786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:35.091786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:35.093229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:35.109456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 73/151] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:34 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:35.115501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:35.238313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbba006-9dba-421a-abae-846c74fc5c72 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:35.328170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:35.328965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.329323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.329678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.331015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:35.340629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589b99d-4e7e-4c0c-9b7d-9a61fd7bf0a1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:35.343442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 79/152] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:34 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:35.345045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003d38-fa9a-42e6-a00c-d6cbcf3a256a None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.345527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003d38-fa9a-42e6-a00c-d6cbcf3a256a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.345890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c003d38-fa9a-42e6-a00c-d6cbcf3a256a None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.347787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 80/153] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:35.353471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c003d38-fa9a-42e6-a00c-d6cbcf3a256a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:35.428417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:35.461370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de71d6-dea4-4595-9431-44a86f50baad None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:35.529659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:35.530623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.531076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.531552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] PATH_INFO: `/v3/users/b6e951d6d5d94c83982a69e1cf2578dc` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] RBAC: Authorizing `identity:get_user(user_id=b6e951d6d5d94c83982a69e1cf2578dc)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:35.534725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1f727-1047-4a4c-b7f6-52675cbd012c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:35.538998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 74/154] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:35 2022] GET /identity/v3/users/b6e951d6d5d94c83982a69e1cf2578dc => generated 290 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:35.540514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.540704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c003d38-fa9a-42e6-a00c-d6cbcf3a256a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:35.541123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.541492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.564559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:35.566084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:35.600239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:35.676097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:35.677054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:35.677487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:35.677894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:35.678854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:35.679406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:35.681066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:35.687107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 75/155] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:35.688601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:35.702093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 81/156] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:35 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 610 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:35.744563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:35.891468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a7c5-3e04-462e-9164-1c13c391d26e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:36.020273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:36.020273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.020273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.020273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.023386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:36.023386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:36.027690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 76/157] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:35 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:36.034023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:36.071181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba852-acee-48a5-a9ef-d79ec014781a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:36.099783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:36.128502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:36.182731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:36.182731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.182731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.183039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.220408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:36.231618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:36.232623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:36.233379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 82/158] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:36.240554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:36.345510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe1b1-82b9-4ed4-bd3d-b3c353388ec6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:36.459385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:36.459385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.459385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.459385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b6e951d6d5d94c83982a69e1cf2578dc/roles/5f4e804b30934e05a351efd607f4627a` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.462045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, user_id=b6e951d6d5d94c83982a69e1cf2578dc, role_id=5f4e804b30934e05a351efd607f4627a)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:36.463544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:36.501282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 77/159] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:36 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/users/b6e951d6d5d94c83982a69e1cf2578dc/roles/5f4e804b30934e05a351efd607f4627a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:36.557904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67642bd-84d8-497b-99b1-4e32d1d80153 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:36.645315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:36.646068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.646358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.646654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.648016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:36.648484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:36.650236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1b28-1d50-45e9-913c-5616560015a8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:36.669790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 83/160] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:36.675596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:36.846060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5bdd7-5e97-4385-a426-bc09a23a5b08 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.846317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5bdd7-5e97-4385-a426-bc09a23a5b08 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.846520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5bdd7-5e97-4385-a426-bc09a23a5b08 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.848098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 84/161] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:36.855820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997adef-bb25-435f-a7bb-1c38f67ca377 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:36.856414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997adef-bb25-435f-a7bb-1c38f67ca377 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:36.856828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997adef-bb25-435f-a7bb-1c38f67ca377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:36.891055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:36.896815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3997adef-bb25-435f-a7bb-1c38f67ca377 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:36.899494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3997adef-bb25-435f-a7bb-1c38f67ca377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:36.921183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac3d1-53c2-4562-8ac7-bd6229d8a45d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:36.966068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:37.013197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:37.013197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:37.013925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:37.014095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] PATH_INFO: `/v3/users/08fbb9e763104d83ac22d69bcd83fff2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:37.020209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] RBAC: Authorizing `identity:get_user(user_id=08fbb9e763104d83ac22d69bcd83fff2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:37.021711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645592-cebc-455c-8bbc-4fa51bd7c785 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:37.023590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 78/162] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:36 2022] GET /identity/v3/users/08fbb9e763104d83ac22d69bcd83fff2 => generated 248 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:37.025426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373fcd-982a-467d-b58f-25f573951d94 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:37.025708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373fcd-982a-467d-b58f-25f573951d94 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:37.025983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373fcd-982a-467d-b58f-25f573951d94 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:37.028694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 79/163] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:37.032450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373fcd-982a-467d-b58f-25f573951d94 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:37.140873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 85/164] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:37.142136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:37.142430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:37.142715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:37.220445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:37.221662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:37.229145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373fcd-982a-467d-b58f-25f573951d94 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:37.304095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:37.305043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:37.305327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:37.305604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:37.351666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:37.431434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:37.433021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:37.505448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 86/165] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:37.506680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:37.632367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 80/166] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:37.634744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:37.786670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:37.813561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224417-f9df-418f-9dc1-8aa15db7f1ea None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:37.832447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:37.938708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:37.939772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:37.940253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:37.940761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:37.980325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:37.985501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0f6da-ea56-4909-8468-8e21987fa736 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:37.986505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:37.987401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:37.988446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:37.995385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 87/167] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:37.996645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.095230 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15124-e654-4145-9306-f831db146196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.096271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15124-e654-4145-9306-f831db146196 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.096747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15124-e654-4145-9306-f831db146196 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.097325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15124-e654-4145-9306-f831db146196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.142548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15124-e654-4145-9306-f831db146196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-b9c15124-e654-4145-9306-f831db146196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:38.148089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:38.148986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:38.149758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:38.156770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 81/168] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 524 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:38.157951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15124-e654-4145-9306-f831db146196 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.198970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f207-a7a7-4ab0-96e2-5ef077a15314 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.273472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.274159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.274443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.274718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.276555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.278922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:38.281194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 88/169] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:37 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:38.281990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.352082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:38.388554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15124-e654-4145-9306-f831db146196 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.408620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:38.434034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.435058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.436914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.437391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.438324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:38.438823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.440551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:38.464272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 82/170] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:38.467002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.569406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1221ff-b901-41bc-b3ee-e4233b58c78b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.644359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.646453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.646931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.648352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.649303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:38.651404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.653068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54f3c1-a18a-4fdf-b61e-9409a979db06 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:38.674672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 89/171] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:38.678182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0905-812c-43d4-8bd0-999232abfa7c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.681632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0905-812c-43d4-8bd0-999232abfa7c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.682168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0905-812c-43d4-8bd0-999232abfa7c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.683808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 90/172] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:38 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:38.684367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf8a8-ada9-46b1-9c6b-460f59357f06 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.686889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de0905-812c-43d4-8bd0-999232abfa7c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.748811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.750436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.751140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.751644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.752862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=08fbb9e763104d83ac22d69bcd83fff2) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:38.753486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.756434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:38.770590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 83/173] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:38 2022] GET /identity/v3/role_assignments?user.id=08fbb9e763104d83ac22d69bcd83fff2&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:38.773148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:38.854475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:38.879237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:38.928627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de0905-812c-43d4-8bd0-999232abfa7c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.940712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3b3bd-65c7-4e99-b887-c4e26b29baf1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:38.993623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.994371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.994574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.995096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.995583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:38.996477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:38.996788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.997311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:38.997311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] PATH_INFO: `/v3/users/b5638f33a9624f84876f38d01842977b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:38.998499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] RBAC: Authorizing `identity:get_user(user_id=b5638f33a9624f84876f38d01842977b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:38.998746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4afe5-8f4b-4472-ba8b-5780189a30d2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.000345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ae24-7820-4428-976a-09997e7b1993 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.000471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 84/174] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:38 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:39.001627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034d32-182a-4c1e-b23c-bc0a21e3fff6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.002752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034d32-182a-4c1e-b23c-bc0a21e3fff6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.002865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 91/175] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:38 2022] GET /identity/v3/users/b5638f33a9624f84876f38d01842977b => generated 276 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:39.002937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034d32-182a-4c1e-b23c-bc0a21e3fff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.008595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccdfc4-0cf0-42ec-b98e-df13d08e74ad None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.008595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccdfc4-0cf0-42ec-b98e-df13d08e74ad None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.008595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccdfc4-0cf0-42ec-b98e-df13d08e74ad None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.009756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 92/176] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:39 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:39.010751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141755-52de-413a-a3a9-50209b6a4e21 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.011038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141755-52de-413a-a3a9-50209b6a4e21 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.011312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141755-52de-413a-a3a9-50209b6a4e21 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.019041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 93/177] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:39 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:39.019041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6141755-52de-413a-a3a9-50209b6a4e21 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.024893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c3034d32-182a-4c1e-b23c-bc0a21e3fff6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:39.024893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c3034d32-182a-4c1e-b23c-bc0a21e3fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:39.129817 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 85/178] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:39.131608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.132238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.132702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.158702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:39.160641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:39.187300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6141755-52de-413a-a3a9-50209b6a4e21 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.204213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.229591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.230259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.230572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.230855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.258451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 86/179] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:39.258451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.268937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.345531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:39.347166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cd0c3-fac8-4393-b335-c2aa36f64689 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.383195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c650f2-acd7-4186-a3e5-f51981e7afe3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.422051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.422720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.423012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.423294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.467173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 94/180] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:39.467852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.468905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.469192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.469493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.490809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:39.492043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:39.498255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:39.499877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.544542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.570804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 95/181] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:39.572189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.617082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 87/182] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:39.618008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.686883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792d2e1-a899-4538-861b-a95bcabcad07 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.695745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.725896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.726475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.726764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.727042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.731565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236769-e791-447e-90a1-ab254ad4d741 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.739036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-83a00d75-b3a0-4f2b-bf2b-596f16723d54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:39.744145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:39.745026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:39.745835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 96/183] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:39.746725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f8b0-dce0-4136-aaca-471dce2b6947 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.746911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f8b0-dce0-4136-aaca-471dce2b6947 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.747257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f8b0-dce0-4136-aaca-471dce2b6947 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.751831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 97/184] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:39.751831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3f8b0-dce0-4136-aaca-471dce2b6947 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.775263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.776067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.776345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.776877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.787972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:39.792991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:39.794160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 88/185] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:39.796197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.802746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.876951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3f8b0-dce0-4136-aaca-471dce2b6947 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.906877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969937b6-5bc2-4ed6-bd66-0f195d15dbc3 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:39.915258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.915967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.916238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.916574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.917756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:39.919692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.921387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 98/186] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:39.922160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:39.938147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:39.944668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:39.945334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:39.945615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:39.945887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:39.947065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:39.948627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:39.950471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 89/187] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:39.955759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.039145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41a05-9ebf-4634-88f4-e8eddcdc8946 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.049436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.068543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16081713-f00b-4619-9b10-8dd7288c90f5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.078500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.079165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.079500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.079783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] PATH_INFO: `/v3/projects/ffd72b38621140d3b0c995951e3a152b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.080992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd72b38621140d3b0c995951e3a152b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.082451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227118a5-29c1-479d-bfa4-64cc25c51e22 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.084175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 99/188] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/projects/ffd72b38621140d3b0c995951e3a152b => generated 313 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.085327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.085614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.085889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.105625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:40.106573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.107608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:40.107716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.107716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.107896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.108673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:40.109026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.110564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.119630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 90/189] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.120203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.186208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 100/190] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:40.186699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.206201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.253661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925b07-5fd9-48d1-b114-7247d262e5f0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.292957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.293528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.293810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.294086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.294844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:40.295135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.296573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.298154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f95b-4eff-49f6-92e9-d78ca751c9ef None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.305277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 91/191] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.305982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.306522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.341094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.341780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.342144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.342331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.343138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:40.343480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.345017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.351128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 101/192] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 610 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.351962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.439076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585c77a-7e0a-4ee2-99e9-b73090a0c4d5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.469481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.491602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873ee01-6c26-40a3-b998-38f5a3045632 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.497037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.497814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.498100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.498378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.499091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.501294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.532585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 92/193] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:40 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:40.533960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.561227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.561414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.561639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.562801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.564149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=ffd72b38621140d3b0c995951e3a152b, user.id=b5638f33a9624f84876f38d01842977b) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:40.564474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.566022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.578887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 102/194] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/role_assignments?user.id=b5638f33a9624f84876f38d01842977b&scope.project.id=ffd72b38621140d3b0c995951e3a152b&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 610 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.582542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.633168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.746716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38163c0-6e99-43c4-a1f1-7f8d183904d2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.773783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5826e0-145b-470d-810b-b72ee88cb048 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:40.806590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.806590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.806590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.806590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.820674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:40.827479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:40.828463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:40.829392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:40.831442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 103/195] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:40.832237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:40.832562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.833105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:40.833457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:40.833802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:40.854730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:40.856110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:40.858418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 93/196] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:40.859585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:40.942511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:40.999780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:41.008931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b6cf-b947-4166-87fa-a9bbd38a3ba9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:41.045855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:41.046594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:41.046960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:41.047329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:41.048726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:41.050239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:41.055476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 104/197] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:41.055860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e126ed6-45ba-4b6e-b0cb-ca0d1990c49d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:41.056492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:41.104149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:41.105324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:41.105795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:41.106222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:41.107150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:41.107788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:41.109526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:41.120397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 94/198] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:40 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:41.126487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:41.264535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952af72b-bdfe-4a48-989a-a603a27dcefd None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:41.326735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:41.331991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2764-af70-4fc1-b716-43610f08c24a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:41.340710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:41.341359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:41.341646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:41.341932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:41.399868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:41.401480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:41.404826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:41.405064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:41.405341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:41.484124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:41.489739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:41.570071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:41.572155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:41.701263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 105/199] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:41.701263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:41.772991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:41.787864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 95/200] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:41.790110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:41.841607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:41.924595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df569e0-2193-4f93-9871-7fd00970a816 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:41.998183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94449-a8df-435d-af56-509a6c1232a8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:42.001073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.001733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.002012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.002375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] PATH_INFO: `/v3/users/b6e951d6d5d94c83982a69e1cf2578dc` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.004451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] RBAC: Authorizing `identity:get_user(user_id=b6e951d6d5d94c83982a69e1cf2578dc)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.005767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.013451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 106/201] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:41 2022] GET /identity/v3/users/b6e951d6d5d94c83982a69e1cf2578dc => generated 290 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:42.014382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:42.065057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.066101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.069865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.070857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.076374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.078421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.080499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 96/202] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:41 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:42.082282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:42.261920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:42.287388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0839fe4-cb79-4f8d-8809-df53875d8d96 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:42.369437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:42.375380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2d34-0054-4ffa-9bb2-0e59109041b1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:42.395458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.399387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.399387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.399387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.404482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.408200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.417110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 107/203] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:42 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:42.420520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:42.504656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.504860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.507381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.507381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.595464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89b1d-b1b6-488c-a184-e89d2cd47bc5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:42.667388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.671387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160138c7-7dfc-43d1-8f98-61691b628dfc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.681111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=1c2dc3079408466d90c84d282115dcd2) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.687381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.694472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 108/204] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:42 2022] GET /identity/v3/role_assignments?user.id=1c2dc3079408466d90c84d282115dcd2&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:42.703390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:42.829790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:42.846668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:42.885196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 97/205] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:42.887482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df85f-b302-4291-9d73-a081f3ca079b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.888412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df85f-b302-4291-9d73-a081f3ca079b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.888838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df85f-b302-4291-9d73-a081f3ca079b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.890613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 98/206] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:42.891230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8c61-71a0-4f4b-833f-e9d04b54cb2d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:42.897031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457df85f-b302-4291-9d73-a081f3ca079b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:42.935673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:42.936426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.937130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.937548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:42.938796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=1c2dc3079408466d90c84d282115dcd2) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:42.939186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:42.940603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d959213-1502-40eb-8f51-bb246fc7a128 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:42.953549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 109/207] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:42 2022] GET /identity/v3/role_assignments?user.id=1c2dc3079408466d90c84d282115dcd2&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:42.955082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d65dd5-8c09-4473-a749-59a2421a80ef None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:42.955565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d65dd5-8c09-4473-a749-59a2421a80ef None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:42.956151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d65dd5-8c09-4473-a749-59a2421a80ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.000224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e5d65dd5-8c09-4473-a749-59a2421a80ef None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:43.003591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e5d65dd5-8c09-4473-a749-59a2421a80ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:43.060603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457df85f-b302-4291-9d73-a081f3ca079b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.093715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 110/208] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:43.096453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214939-c059-43bf-9f8d-d60440159aef None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.097067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214939-c059-43bf-9f8d-d60440159aef None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.097581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214939-c059-43bf-9f8d-d60440159aef None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.106577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 111/209] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:43 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:43.109066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.109724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.110377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.118045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.119157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.119673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.120187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.122355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.124209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.126284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 99/210] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:42 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:43.127292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.136141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:43.137566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:43.182366 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.203200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.235391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 112/211] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:43.235391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.268794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b395-0dcd-42c6-8df5-baba49efc3f1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.305420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.306471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.306972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.307468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.319831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:43.326301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:43.327194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:43.327993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:43.330508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 100/212] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:43.331555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.343259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf037fd-2d64-41e0-8a55-9aff61eda32c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.383733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.384348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.384575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.384828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.385633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, scope.project.id=cd783f0145474a5f850e2646d2e4c37e, user.id=b6e951d6d5d94c83982a69e1cf2578dc) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:43.385946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.387726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.394476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 113/213] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/role_assignments?user.id=b6e951d6d5d94c83982a69e1cf2578dc&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=5f4e804b30934e05a351efd607f4627a => generated 610 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:43.395398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.446330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.454289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.456785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951cb41-fb9c-41c0-9cd8-1f7187847c2d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.500692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.501805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.502279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.502856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.504350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.506235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.508283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 101/214] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:43.514141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8c77e-8703-457c-b997-7e8b2dfa5a48 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.515713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.556224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.556876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.557835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.557835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.560229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:43.560595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.562200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.579025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 114/215] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:43.587208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.696346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64311-41b7-4c9e-b242-d31b332ee472 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.721802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401894da-dd97-4bdf-b973-035d3b9c5174 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.736510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.737178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.738901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.739425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.739891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.740802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.742521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.771279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.772503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.773060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.773347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] PATH_INFO: `/v3/users/7adccbe5de15423aaab5414cf4f6ff36` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:43.781758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 102/216] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:43 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:43.791424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7adccbe5de15423aaab5414cf4f6ff36)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:43.794486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:43.794615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 115/217] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/users/7adccbe5de15423aaab5414cf4f6ff36 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:43.800880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:43.840493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:43.936823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f883c-269f-4cd6-8726-9db0990ea47b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:43.974662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:43.975311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:43.975655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:43.975989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:44.061210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:44.062745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:44.084073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:44.189478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 103/218] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:44.197084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:44.330233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516faa-69f5-4949-b56d-a329bd43f4b0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:44.367431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:44.368194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:44.368468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:44.368749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:44.369950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:44.371527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2194d0-7d2e-42b5-b02d-b3daa3ece760 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:44.373539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 116/219] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:44 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:44.379944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:44.486284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b384-dc58-47ab-aaf1-e3e830c4797c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:44.512013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:44.532277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:44.532935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:44.533218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:44.533494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:44.534328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=7adccbe5de15423aaab5414cf4f6ff36) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:44.534643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:44.536471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0caafd-fdc9-47f1-b2b9-d217086b2e04 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:44.542662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 104/220] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:44 2022] GET /identity/v3/role_assignments?user.id=7adccbe5de15423aaab5414cf4f6ff36&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:45.072247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190efc-afa8-4a01-930e-9d0771933fbc None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.072754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190efc-afa8-4a01-930e-9d0771933fbc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.072826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190efc-afa8-4a01-930e-9d0771933fbc None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.074557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 117/221] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:45.080276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7504cd-7f81-4bab-a26f-b2ec82c4745a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.080565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7504cd-7f81-4bab-a26f-b2ec82c4745a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.080844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7504cd-7f81-4bab-a26f-b2ec82c4745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.103785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fd7504cd-7f81-4bab-a26f-b2ec82c4745a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:45.104995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fd7504cd-7f81-4bab-a26f-b2ec82c4745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:45.202211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 105/222] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:45.233275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a190efc-afa8-4a01-930e-9d0771933fbc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.291320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:45.339264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800715-3c3e-4b69-903a-0283f2ccc265 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.339943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800715-3c3e-4b69-903a-0283f2ccc265 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.340480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800715-3c3e-4b69-903a-0283f2ccc265 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.342073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 106/223] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:45.347628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.348154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.348623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.370705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a190efc-afa8-4a01-930e-9d0771933fbc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:45.393307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:45.394493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:45.441015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:45.442032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.442505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.442992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.471701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:45.476724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:45.477577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:45.478348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 118/224] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:45.483784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.499149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 107/225] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:45.533348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.586449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:45.590600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8262-0412-4e80-adc6-8b1a0b94e442 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:45.625300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:45.630283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:45.630947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.631233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.631548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.632487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:45.632909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:45.634697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:45.644817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 119/226] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:45.653289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.758509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c36cb2-6346-40b8-9a21-3519fac114e9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:45.783596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba218f-804d-42cc-a088-7d6ea399c13d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:45.804233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:45.805118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.805537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.805950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.809109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:45.811600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:45.815807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 120/227] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:45.822898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.844047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:45.844821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.845107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.845385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:45.870709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:45.871336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:45.882512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:45.883491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:45.884298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 108/228] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:45.892468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:45.949980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad019afc-7d20-4551-a5e8-fc3b3035bd4a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:45.987087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:45.992105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:45.992547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:45.992967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.000193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.001920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.003917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 121/229] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:46.010231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:46.072840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0146-95b9-4b93-ab0e-9a2ef91656c9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:46.077672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:46.147137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:46.147806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.148084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.148354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.149085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:46.149388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.150793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.173682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 109/230] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:46.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae31e-b086-4d9f-96b5-f6570cbe7463 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:46.184605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:46.200020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:46.218488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:46.219563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.220100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.220568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/users/1c2dc3079408466d90c84d282115dcd2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.222903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, user_id=1c2dc3079408466d90c84d282115dcd2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.225190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.244045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 122/231] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:46 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/users/1c2dc3079408466d90c84d282115dcd2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:46.338639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0c80-9f6a-459c-9920-53e49d3c1086 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:46.382767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:46.383957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.384434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.384956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.386409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.389017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.390896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 110/232] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:46 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:46.396632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:46.528638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3215af9-7600-4319-8c29-fbfac558e78f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:46.565119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:46.565785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.566065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.566338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.567541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.568997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d1a6d-48fe-4fd3-bc50-333857067e78 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.570716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 123/233] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:46 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:46.576680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:46.622976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:46.710407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11168a8-7b3e-48ce-8573-8d510102c9aa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:46.725208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f417-b1e2-4a8c-bdb4-f598c276a568 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.726016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f417-b1e2-4a8c-bdb4-f598c276a568 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.726016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f417-b1e2-4a8c-bdb4-f598c276a568 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.728099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 124/234] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:46.736789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42415f-71ef-47ee-9be8-f68038fd8882 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.737119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42415f-71ef-47ee-9be8-f68038fd8882 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.737344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42415f-71ef-47ee-9be8-f68038fd8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.747091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:46.752175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.752462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.752745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/users/1c2dc3079408466d90c84d282115dcd2/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.758774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2a42415f-71ef-47ee-9be8-f68038fd8882 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:46.759998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2a42415f-71ef-47ee-9be8-f68038fd8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:46.761268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, user_id=1c2dc3079408466d90c84d282115dcd2, role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:46.763608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3aaca6-ad49-4f43-8a69-738d234c7602 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:46.784200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 111/235] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:46 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/users/1c2dc3079408466d90c84d282115dcd2/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:46.791769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:46.884845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 125/236] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:46.904605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbec71-cec3-452a-b5dd-8fc8fd24ceee None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.904939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbec71-cec3-452a-b5dd-8fc8fd24ceee None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.905160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbec71-cec3-452a-b5dd-8fc8fd24ceee None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.906567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 112/237] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:46.912759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57da98-b566-44b9-8a76-d709c259c51f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:46.913136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57da98-b566-44b9-8a76-d709c259c51f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:46.913319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57da98-b566-44b9-8a76-d709c259c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:46.928618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbec71-cec3-452a-b5dd-8fc8fd24ceee None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:46.947057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-5e57da98-b566-44b9-8a76-d709c259c51f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:46.948293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5e57da98-b566-44b9-8a76-d709c259c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:47.031710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 126/238] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:47.033218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37813c-f00e-4aab-b772-d1c7c58eceac None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.033506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37813c-f00e-4aab-b772-d1c7c58eceac None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.033777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37813c-f00e-4aab-b772-d1c7c58eceac None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.035463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 127/239] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:47.040967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.041346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.041624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.048991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.067747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:47.068654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbec71-cec3-452a-b5dd-8fc8fd24ceee None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.068920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:47.110372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.111026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.111302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.111638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.113219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.115058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.117451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 113/240] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:47.120271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.150625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 128/241] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:47.151569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.179799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.266948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49d7c3-cd6a-4ca7-97b7-7a5c98f7b717 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.272328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58186e8-99a2-4c85-b6c5-e9c4454a4670 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.308881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.309611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.309886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.310002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.310184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.310540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.310821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.310918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.311095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.312495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.322384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:47.328995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:47.331108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:47.332996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 114/242] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:47.337182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.348358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 129/243] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:47 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:47.349384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.382062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.515792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.546594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710741c-8015-47fd-acab-331e47ee7c40 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.555557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadf9c-1701-4226-a8b8-4728c55f0f57 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.589150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.589897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.590941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.591306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.598517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.599160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.599471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.599750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.600790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:47.601098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.602916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.604262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:47.610521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:47.612618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:47.614497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:47.620235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 130/245] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:47.620383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 115/245] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:47.620528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.620683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.719740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.750899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991ed-497b-4549-818f-d6425ff74655 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.764162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d972e8-b113-47d8-b52f-ae37c4649df4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.794500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.795090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.795396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.795697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] PATH_INFO: `/v3/users/7adccbe5de15423aaab5414cf4f6ff36` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.796913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] RBAC: Authorizing `identity:get_user(user_id=7adccbe5de15423aaab5414cf4f6ff36)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.798388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.800038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 116/246] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/users/7adccbe5de15423aaab5414cf4f6ff36 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:47.800778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:47.807571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.811302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.811973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.813233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.813525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.814267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:47.814579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.816003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.827516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 131/247] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:47.833692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:47.940857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fc3f-a756-491e-b0d0-443b1883636d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.959721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575b30c-5a97-4b34-bfca-4a4b7912ecc1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:47.985213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:47.985886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:47.986169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:47.986443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:47.987966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:47.990074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:47.992200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 117/248] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:47.998546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:48.019516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:48.020190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:48.021272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.021493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.021774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] PATH_INFO: `/v3/users/0a17a310a23340dfb1e858030a00cfa5` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.038903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] RBAC: Authorizing `identity:get_user(user_id=0a17a310a23340dfb1e858030a00cfa5)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:48.040507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:48.042293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 132/249] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:47 2022] GET /identity/v3/users/0a17a310a23340dfb1e858030a00cfa5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:48.048506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:48.125563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:48.128897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eda4c3-c1a9-489c-9774-298d0b982f64 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:48.165343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:48.166080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.166357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.166680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/users/7adccbe5de15423aaab5414cf4f6ff36/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.169438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, user_id=7adccbe5de15423aaab5414cf4f6ff36, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:48.170963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:48.186571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3bab-236d-421f-b78e-ee7251bb2a99 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:48.206157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 118/250] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:47 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/users/7adccbe5de15423aaab5414cf4f6ff36/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:48.254279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:48.254941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.255226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.255577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.358088 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:48.359558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:48.430929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:48.501709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 133/251] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:48.508502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:48.624910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:48.654660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf06f8-f143-449b-a015-d1f457752238 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:48.691043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:48.691720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.692000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.692274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.693460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:48.694990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb55476-457f-4e99-9e09-3fdbea89a5cb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:48.696708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 119/252] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:48 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:48.702970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:48.770509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f025a-2e35-418a-b3a3-50884a1f306f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.770812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f025a-2e35-418a-b3a3-50884a1f306f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.771058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f025a-2e35-418a-b3a3-50884a1f306f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.772444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 120/253] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:48.779252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.779552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.779820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.808611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:48.810143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:48.857951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d307b-7740-496f-8843-fab0309648e4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:48.931939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:48.932540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:48.932822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:48.933096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:48.934186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=0a17a310a23340dfb1e858030a00cfa5) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:48.934597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:48.936104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:48.940940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 121/254] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:48.944613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 134/255] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:48 2022] GET /identity/v3/role_assignments?user.id=0a17a310a23340dfb1e858030a00cfa5&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=5f4e804b30934e05a351efd607f4627a => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:48.989405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:49.090157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:49.116138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98a401-b4fa-4b4e-b7bc-9bdddd3afb07 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:49.160943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:49.161612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.161893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.162164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.185773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:49.191334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:49.192312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:30:49.193105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:49.195993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 122/256] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:49.202485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:49.235234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:49.328776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9294f-94b1-460d-9847-ce190b124b5b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:49.368292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:49.368949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.369236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.369517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.370260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:49.370569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:49.372130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7b65-d64f-48a9-82f0-652183df98ef None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:49.381610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 135/257] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:49.387978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:49.516333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa970e2-52a9-43c1-96b9-d65cb77053eb None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.516687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa970e2-52a9-43c1-96b9-d65cb77053eb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.516902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa970e2-52a9-43c1-96b9-d65cb77053eb None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.518281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 136/258] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:49.523159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.523473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.523753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.538840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a288-aee5-41d6-b652-780f72ebb270 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:49.551420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:49.552643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:49.602154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:49.602817 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.603100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.603392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.604813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:49.606369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:49.608037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 123/259] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:49 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:49.614125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:49.620066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:49.681959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 137/260] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:49.717086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:49.731722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:49.805423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6621e-ccfd-4757-bb04-985d256cd5b4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:49.851179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f563a1f-e798-459c-bc65-c99c5ac4fcab None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:49.905216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:49.906697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.907529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:49.908420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:49.908882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.909336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.910668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:49.911146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:49.936454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:49.942992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:49.943884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:30:49.944725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:49.948643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 138/261] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:30:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:49.954166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.003245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.005384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.019744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.033529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.069472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188992-5e55-4201-bec0-94b8be0d03be None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.127010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 124/262] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:50.131564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.131564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.131844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.132151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.132971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:50.133333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.133946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.152856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 139/263] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:30:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:50.158076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.236778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c458-7af0-4b19-80cc-b8235e232606 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.239943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.272837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.273837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.274376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.274879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.276279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.278257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.285427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 125/264] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:50.287077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.353420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acbdca-886f-4184-b477-3b68f5a16d86 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.394415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7862-a23a-4a98-bece-6b953fdd5430 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.407094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.424111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.424786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.425072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.425352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] PATH_INFO: `/v3/users/1c2dc3079408466d90c84d282115dcd2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.426620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] RBAC: Authorizing `identity:get_user(user_id=1c2dc3079408466d90c84d282115dcd2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.428125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.430350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 140/265] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/users/1c2dc3079408466d90c84d282115dcd2 => generated 284 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:50.435768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.440140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.441350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.443855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.444354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.445403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=1c2dc3079408466d90c84d282115dcd2) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:50.447602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.454441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.464898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 126/266] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/role_assignments?user.id=1c2dc3079408466d90c84d282115dcd2&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:50.558463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71238f-502e-4908-8df6-69dea8bda63a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.594923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.595959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.596438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.596928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.667838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.671190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.677149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.792456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 141/267] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 20:30:50.798187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:50.847708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:50.925839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130f48-8c24-450c-bdcc-f8bdd44a7e3f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:50.959831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:50.962642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:50.962642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:50.962642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:50.962642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:50.963685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3e4d-1ade-4458-8481-ca1939d31ba4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:50.965886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 127/268] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:50.971757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.080967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.086313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679a073-4935-4909-839f-98d76f7d0af1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.109589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76e56-9b8f-4780-a2a6-a9a5425b21e7 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.109930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76e56-9b8f-4780-a2a6-a9a5425b21e7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.110206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76e56-9b8f-4780-a2a6-a9a5425b21e7 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.111797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 128/269] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:51.116890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1efd-6594-4273-afca-58186b0dbe1b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.117177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1efd-6594-4273-afca-58186b0dbe1b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.117455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1efd-6594-4273-afca-58186b0dbe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.143612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b2fc1efd-6594-4273-afca-58186b0dbe1b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:51.144808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b2fc1efd-6594-4273-afca-58186b0dbe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:51.148759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.149403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.149687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.149967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.150776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=1c2dc3079408466d90c84d282115dcd2) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:51.151093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:51.152640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:51.165196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 142/270] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:50 2022] GET /identity/v3/role_assignments?user.id=1c2dc3079408466d90c84d282115dcd2&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:51.258220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 129/271] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:51.293617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.347186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ef0a6-bf2b-427f-9e5a-cb40c20d8c12 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.347569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ef0a6-bf2b-427f-9e5a-cb40c20d8c12 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.347764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ef0a6-bf2b-427f-9e5a-cb40c20d8c12 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.349160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 130/272] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:51.354833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488524-9ba8-4ec0-b6fd-620795ceb22a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.355150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488524-9ba8-4ec0-b6fd-620795ceb22a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.355622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52488524-9ba8-4ec0-b6fd-620795ceb22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.383885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-52488524-9ba8-4ec0-b6fd-620795ceb22a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:51.385080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-52488524-9ba8-4ec0-b6fd-620795ceb22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:51.426798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.458163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd242ae-4ed6-4328-88c5-c1de8c06a2ba None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.483450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 131/273] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 20:30:51.485091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975a33-60b0-49fe-9464-230ea3c32c67 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.485576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975a33-60b0-49fe-9464-230ea3c32c67 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.486041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975a33-60b0-49fe-9464-230ea3c32c67 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.487602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 132/274] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:51.497576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.498441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.499439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.507860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.509540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.509774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.510054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.523248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:51.523248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:51.524350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:51.531304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:51.532248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:51.533035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 143/275] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:51.533679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.564405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 133/276] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:51.606389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.656914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90cc44-dad8-464a-b977-f26cfc8bf7d7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.691796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.692458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.692742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.693021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.704002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:51.708833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:51.709541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:51.710508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:51.711287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 144/277] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:51.712426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.724620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58675-8e5f-45d1-9063-14b9d81062c3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.761383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.762472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.762791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.763056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.763843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:51.764149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:51.765540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:51.774273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 134/278] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:51.775075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.807183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.827804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f139-dca1-4b31-bec9-22c490fb6df5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.861211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.861868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.862153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.862433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.863662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:51.865132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:51.866795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 145/279] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:51.867581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.889648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828c71-720f-4ab3-adf0-99b28f625105 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:51.924341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:51.924966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.925243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.925524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.926248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:51.926554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:51.927983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c231edf-0f77-44a5-b6ff-5b0e273559f9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:51.936251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 135/280] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:51.937255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc039-07b8-4c58-8c4e-3d81fd57d9a8 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:51.937545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc039-07b8-4c58-8c4e-3d81fd57d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:51.937832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc039-07b8-4c58-8c4e-3d81fd57d9a8 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:51.939170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 136/281] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:51 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:51.939758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cc039-07b8-4c58-8c4e-3d81fd57d9a8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:51.958186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:51.975222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00f84-4780-4464-af4b-aa048856349e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.010382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.011056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.011466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.011867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] PATH_INFO: `/v3/users/a7293832ade84bdbb89e48d6c65a7199` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.026425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] RBAC: Authorizing `identity:get_user(user_id=a7293832ade84bdbb89e48d6c65a7199)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.028052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.029731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 146/282] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:51 2022] GET /identity/v3/users/a7293832ade84bdbb89e48d6c65a7199 => generated 294 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:52.030525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.040924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.049084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cc039-07b8-4c58-8c4e-3d81fd57d9a8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.083260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.083910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.084192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.084446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.085135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.086590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01fe67-3559-4e63-87a3-57bd70979639 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.107372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 137/283] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:30:51 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:52.108620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.108910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.109188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.128534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:52.129768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:52.149660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40c12-8d5d-4e8b-840b-246ce41b4892 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.190069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.190737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.191024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.191296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] PATH_INFO: `/v3/users/7adccbe5de15423aaab5414cf4f6ff36` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.192609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] RBAC: Authorizing `identity:get_user(user_id=7adccbe5de15423aaab5414cf4f6ff36)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.194121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.196250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 147/284] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/users/7adccbe5de15423aaab5414cf4f6ff36 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:52.197039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.213110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 138/285] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:52.214003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.217359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.299272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.328507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90520-f6d2-4c13-96cc-5362ff03cc58 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.339342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d75d0-f04e-43e3-9652-7851d75d2b48 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.378188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.379195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.379677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.380084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.381102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, user.id=a7293832ade84bdbb89e48d6c65a7199, scope.system=all) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:52.381656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.383228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.383470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.384067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.384411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.384754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.391842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 148/286] 10.222.0.100 () {56 vars in 1313 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/role_assignments?user.id=a7293832ade84bdbb89e48d6c65a7199&scope.system=all&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 227 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:52.392984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.476774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.478313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.480511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.539256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a315-62c9-41fc-81f1-e8bb5353541e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.588462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.589770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.590105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.590335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.602490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.606359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 139/287] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:52.607890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.608447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:52.615086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:52.616174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:52.616954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:52.619991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 149/288] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:52.628641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.777956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0379-ced3-4159-87f3-294343d90bf2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.816647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.817288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.817573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.817849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.818576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:52.818881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.820447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.822649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6020561-612f-41b7-aa43-34b40a427765 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:52.824735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:52.831806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 150/289] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:52.840931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.892939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:52.893630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:52.893866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:52.894141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:52.895480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:52.897744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:52.901669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 140/290] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:52.906771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:52.974676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:53.049966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e03cba-8ee9-4aaa-b513-28711eab11d0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:53.075594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b8e7d-926e-430e-8c19-b46927fc1aec None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:53.085452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:53.086078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:53.086426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:53.086706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:53.087545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=7adccbe5de15423aaab5414cf4f6ff36) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:53.087857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:53.089301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:53.096505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 141/291] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/role_assignments?user.id=7adccbe5de15423aaab5414cf4f6ff36&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:53.165388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:53.166054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:53.166335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:53.166610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] PATH_INFO: `/v3/users/0a17a310a23340dfb1e858030a00cfa5` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:53.172156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0a17a310a23340dfb1e858030a00cfa5)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:53.173684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:53.175751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 151/292] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:52 2022] GET /identity/v3/users/0a17a310a23340dfb1e858030a00cfa5 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:53.181316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:53.251804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:53.303958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc8df-32cb-4705-ac7e-1cd83657e89a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:53.344946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:53.345611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:53.345889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:53.346159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:53.347396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:53.348808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6594ad-c7da-44b5-b214-709ac5566ce1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:53.350476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 142/293] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:53 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:53.356575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:53.489261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e711e1-1021-450b-992a-65c62a0b63f3 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:53.523044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:53.530688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:53.531454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:53.531745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:53.532021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/users/0a17a310a23340dfb1e858030a00cfa5/roles/5f4e804b30934e05a351efd607f4627a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:53.535416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, user_id=0a17a310a23340dfb1e858030a00cfa5, role_id=5f4e804b30934e05a351efd607f4627a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:53.536990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2266d2c-6324-49ce-88a8-6ad1d325b768 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:53.556939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 152/294] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:30:53 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/users/0a17a310a23340dfb1e858030a00cfa5/roles/5f4e804b30934e05a351efd607f4627a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:30:54.408550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d937f2-7811-4e98-a6d0-a1a28f1b467b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.409042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d937f2-7811-4e98-a6d0-a1a28f1b467b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.409042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d937f2-7811-4e98-a6d0-a1a28f1b467b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.410946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 143/295] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:54.416245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.416541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.416821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.435908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:54.437105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:54.473386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c47-ef90-4d25-9614-a1031ca34293 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.473995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c47-ef90-4d25-9614-a1031ca34293 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.474463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65c47-ef90-4d25-9614-a1031ca34293 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.475968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 144/296] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:54.481902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.481902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.481902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.505446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:54.506830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:54.508651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 153/297] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:54.530884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:54.590070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 145/298] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:54.612278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:54.640545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1f7c0-54cd-4337-8dbd-891d856831cb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:54.645057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:54.671415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:54.689057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:54.689873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.690307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.690678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.692070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:54.694016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:54.697082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 154/299] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:54 2022] GET /identity/v3/domains/default => generated 200 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:54.702445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:54.741528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3128257-69f3-4617-9f31-11df2d6e378d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:54.791882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:54.792900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.793184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.793482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.807076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-fc620256-74f8-4905-827f-1557eb701b40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:54.812919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:54.813785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:54.814553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 146/300] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:54.815530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ae15-80ed-47e3-ad2c-b0919e8dc875 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.815619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ae15-80ed-47e3-ad2c-b0919e8dc875 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.815862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ae15-80ed-47e3-ad2c-b0919e8dc875 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.817240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 147/301] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:54 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:54.820250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ae15-80ed-47e3-ad2c-b0919e8dc875 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:54.836230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9298ef-f82c-4f46-9e61-dbe3d14b861d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:54.878147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:54.878775 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.879054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.879328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] PATH_INFO: `/v3/groups` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.880017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:54.881453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b696-0763-48fd-aa3f-318f8d801d72 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:54.899573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 155/302] 10.222.0.100 () {60 vars in 1139 bytes} [Fri Aug 5 20:30:54 2022] POST /identity/v3/groups => generated 230 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:30:54.900946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.901263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.901531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.927557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:54.930837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:54.932114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:54.942096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ae15-80ed-47e3-ad2c-b0919e8dc875 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:54.984168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:54.984646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:54.985557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:54.986105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:54.986566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:54.987642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:54.988198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:54.989903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.000572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 148/303] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:55.005869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.023539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 156/304] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:55.047075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.140894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62866-2596-4670-8713-5fd5617970e6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.173158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6fb05-2dce-47bd-bd23-f50ef0570e22 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.179829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.180450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.180731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.181006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] PATH_INFO: `/v3/users/a2abcd1bbe6b4500b6ff708afd67d874` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.195727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] RBAC: Authorizing `identity:get_user(user_id=a2abcd1bbe6b4500b6ff708afd67d874)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:55.197195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.199278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 149/305] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/users/a2abcd1bbe6b4500b6ff708afd67d874 => generated 294 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:55.205062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.221151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.222176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.222652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.223114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.223519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:55.238201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:55.243723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:55.244623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:55.245505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:55.248422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 157/306] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:30:55.259436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.298648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:55.339040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44703d-5cf4-4332-8acd-91fbcc0438a5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.364784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17827a3-9ff6-4334-82fe-02ebf13e37fb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.388549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.389424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.389715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.390046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.391295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, user.id=a2abcd1bbe6b4500b6ff708afd67d874, scope.system=all) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:55.391650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:55.393645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.400921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 150/307] 10.222.0.100 () {56 vars in 1313 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/role_assignments?user.id=a2abcd1bbe6b4500b6ff708afd67d874&scope.system=all&role.id=5f4e804b30934e05a351efd607f4627a => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:55.402555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.403507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.403958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.404398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.405374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:55.405894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:55.407783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.423315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 158/308] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:55.425075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.512941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:55.538900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431defe-3e69-4c55-a498-a781d6a701d6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.576322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.576989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.577269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.577545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] PATH_INFO: `/v3/users/a7293832ade84bdbb89e48d6c65a7199` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.578748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=a7293832ade84bdbb89e48d6c65a7199)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:55.581014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b60f4-ac88-496a-8117-c277d8c1e9c9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.583432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 151/309] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/users/a7293832ade84bdbb89e48d6c65a7199 => generated 294 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:55.587990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.656451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ba8c-dfae-4fbf-b6a4-74bfdd20b1df None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.656775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ba8c-dfae-4fbf-b6a4-74bfdd20b1df None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.657007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ba8c-dfae-4fbf-b6a4-74bfdd20b1df None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.658364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 152/310] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:55.663687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.663970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.664244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.684012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:55.685417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:55.695193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:55.699318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1bd1-add2-4b1d-97e4-a0e67c8acaca None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.741848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.742559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.742842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.743122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] PATH_INFO: `/v3/system/users/a7293832ade84bdbb89e48d6c65a7199/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.744635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a7293832ade84bdbb89e48d6c65a7199, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:55.746064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:55.756994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 159/311] 10.222.0.100 () {58 vars in 1339 bytes} [Fri Aug 5 20:30:55 2022] PUT /identity/v3/system/users/a7293832ade84bdbb89e48d6c65a7199/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:30:55.769442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 153/312] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:55.796397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:55.918860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65446d-b270-4325-aa6d-555e01b61cfa None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:55.954567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:55.955251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:55.955565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:55.955848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:55.977019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:55.982638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:55.983582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:55.984608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 160/313] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:55.989803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:56.069733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:56.099385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd912d-95da-4151-a9c2-d5fdc2e956d7 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:56.135384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:56.135384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:56.135384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:56.135384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:56.136037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:56.136037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:56.139386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:56.147586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 154/314] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:55 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:56.152770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:56.179610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:56.265832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c915-a3fb-475b-8815-09f4c95ab5b9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:56.300329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:56.301357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:56.301852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:56.302330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] PATH_INFO: `/v3/users/0a17a310a23340dfb1e858030a00cfa5` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:56.303723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] RBAC: Authorizing `identity:get_user(user_id=0a17a310a23340dfb1e858030a00cfa5)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:56.305382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:56.307721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 161/315] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:56 2022] GET /identity/v3/users/0a17a310a23340dfb1e858030a00cfa5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:56.313068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:56.429761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488df709-fbe3-42c3-b808-055af238c9d2 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:56.466634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:56.467304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:56.467620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:56.467893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:56.471346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:56.538900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:56.540406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:56.646282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 155/316] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:30:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:30:56.651804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:56.749382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:56.758551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8561c2-18bc-4805-a648-0477d8add4ba None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:56.793896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:56.794858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:56.795255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:56.795569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:56.797163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:56.798627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68736cb0-ed93-48d6-9ed4-59e9e14c816f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:56.800629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 162/317] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:30:56 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:56.806243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:56.867748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:56.911311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af2fd7-2ba9-4984-9b01-2e2c625e5521 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:56.948026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:56.948652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:56.949014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:56.949490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:56.950587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, scope.project.id=47bff2574c8741068a2fd649d3786455, user.id=0a17a310a23340dfb1e858030a00cfa5) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:56.950898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:56.952388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff971aad-9858-48e8-b348-59b3fd82e3af None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:56.960009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 156/318] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:30:56 2022] GET /identity/v3/role_assignments?user.id=0a17a310a23340dfb1e858030a00cfa5&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=5f4e804b30934e05a351efd607f4627a => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:57.155395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905cb-84be-464b-94be-f810a888dd11 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.155730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905cb-84be-464b-94be-f810a888dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.155927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905cb-84be-464b-94be-f810a888dd11 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.157381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 163/319] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:30:57.163210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.163523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.163797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.184401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:57.185950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:57.255639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 157/320] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:30:57.278560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261905cb-84be-464b-94be-f810a888dd11 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:57.387239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261905cb-84be-464b-94be-f810a888dd11 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:57.427862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:57.428724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.429144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.429552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.431225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:57.433591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b4389-a13e-4f71-a8c7-41d8263d7ff6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:57.441259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 164/321] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:30:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:57.442553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:57.476793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:57.524885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576b9d-3381-49d2-833c-5cd527e5f0b3 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.525219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576b9d-3381-49d2-833c-5cd527e5f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.525470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576b9d-3381-49d2-833c-5cd527e5f0b3 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.526797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 165/322] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:57.532539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcc57d-af2e-42ae-8451-f1a0b3eae126 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.532823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcc57d-af2e-42ae-8451-f1a0b3eae126 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.533116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcc57d-af2e-42ae-8451-f1a0b3eae126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.552334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f7dcc57d-af2e-42ae-8451-f1a0b3eae126 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:57.553539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f7dcc57d-af2e-42ae-8451-f1a0b3eae126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:57.556086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c4e7-8828-4cb6-8f67-dae86d13de8a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:57.578939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:57.600347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:57.601052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.601333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.601617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] PATH_INFO: `/v3/groups` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.602319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:57.603871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:57.622458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 158/323] 10.222.0.100 () {60 vars in 1139 bytes} [Fri Aug 5 20:30:57 2022] POST /identity/v3/groups => generated 227 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:30:57.638495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 166/324] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:57.661531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:57.765147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:57.777288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921cbc5-f112-4680-a608-5a82b67d0dba None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:57.818891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:57.819114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737ca0-a47c-4db0-a3ea-4a3c83b7630e None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.819561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737ca0-a47c-4db0-a3ea-4a3c83b7630e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.819631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.819697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737ca0-a47c-4db0-a3ea-4a3c83b7630e None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.819881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.820111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.821095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 167/325] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:30:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:30:57.826440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:57.826728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:57.827009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:57.831631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:57.838188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:57.839062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:30:57.839997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:30:57.844286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 159/326] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:57.845182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:57.852586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:30:57.853874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:30:57.943537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 168/327] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:30:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:30:57.966608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:57.972261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90016-7159-43a6-9e76-b658018ebaab None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.019649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.020221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.020609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.020782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.021517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:58.021826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.023220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.037399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 160/328] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:57 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:58.043440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:58.061315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:58.077820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:58.093581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00563ca3-cba2-4695-8810-571e6b41b962 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.138061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.138777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.139068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.139350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.150995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:30:58.156373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:30:58.157269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:30:58.158075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 169/329] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:30:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:30:58.164464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:58.191525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fec74-7283-48d9-984c-7c4141a782f0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.239371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.240028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.240304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.240589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] PATH_INFO: `/v3/users/a2abcd1bbe6b4500b6ff708afd67d874` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.241748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] RBAC: Authorizing `identity:get_user(user_id=a2abcd1bbe6b4500b6ff708afd67d874)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.243196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.244837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 161/330] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:58 2022] GET /identity/v3/users/a2abcd1bbe6b4500b6ff708afd67d874 => generated 294 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:58.252342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:58.305585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775410e0-2776-453c-aa88-4daddc00842a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.355984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.356622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.356901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.357173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.357897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:58.358201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.359604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.369274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 170/331] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:30:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:30:58.371265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:58.375161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:58.391628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:30:58.394278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7542777-1eaf-4565-88f3-c1877317516c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.435689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.436384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.436735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.436947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] PATH_INFO: `/v3/system/users/a2abcd1bbe6b4500b6ff708afd67d874/roles/5f4e804b30934e05a351efd607f4627a` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.438566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2abcd1bbe6b4500b6ff708afd67d874, role_id=5f4e804b30934e05a351efd607f4627a)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.440100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.450080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 162/332] 10.222.0.100 () {58 vars in 1339 bytes} [Fri Aug 5 20:30:58 2022] PUT /identity/v3/system/users/a2abcd1bbe6b4500b6ff708afd67d874/roles/5f4e804b30934e05a351efd607f4627a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:30:58.533991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d293-2b5c-4b0b-a4bc-dad97dbdfff7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.577896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.578493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.578780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.579062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] PATH_INFO: `/v3/users/a7293832ade84bdbb89e48d6c65a7199` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.580405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] RBAC: Authorizing `identity:get_user(user_id=a7293832ade84bdbb89e48d6c65a7199)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.582064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815132-0466-4d72-b0ce-e80c1266913a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.583833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 171/333] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:30:58 2022] GET /identity/v3/users/a7293832ade84bdbb89e48d6c65a7199 => generated 294 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:30:58.589970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:30:58.709391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c372d7-114b-4b4d-8de1-d3eca2968a6a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:30:58.744659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:30:58.745293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:30:58.745576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:30:58.745886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:30:58.746705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] RBAC: Adding query filter params (role.id=f471e7fbe9e344549f74ea85c7fa0fe1, user.id=a7293832ade84bdbb89e48d6c65a7199, scope.system=all) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:30:58.747003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:30:58.748494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80fbe-ad8e-46d4-92d3-f24c1e66d5f1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:30:58.761510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 163/334] 10.222.0.100 () {56 vars in 1313 bytes} [Fri Aug 5 20:30:58 2022] GET /identity/v3/role_assignments?user.id=a7293832ade84bdbb89e48d6c65a7199&scope.system=all&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 512 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:00.691725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a368-4346-4357-af9f-f4402bc620bc None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:00.692544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a368-4346-4357-af9f-f4402bc620bc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:00.692544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a368-4346-4357-af9f-f4402bc620bc None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:00.693944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 172/335] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:00.706730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73a92-5a85-4b40-82c1-457d2e773e23 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:00.707438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73a92-5a85-4b40-82c1-457d2e773e23 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:00.707438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73a92-5a85-4b40-82c1-457d2e773e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:00.714432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:00.734735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-96c73a92-5a85-4b40-82c1-457d2e773e23 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:00.736330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-96c73a92-5a85-4b40-82c1-457d2e773e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:00.814276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 164/336] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:00.851129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a368-4346-4357-af9f-f4402bc620bc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:00.881407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2e02-bae0-4856-9072-25b691cb2838 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:00.881996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2e02-bae0-4856-9072-25b691cb2838 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:00.882454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2e02-bae0-4856-9072-25b691cb2838 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:00.884034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 165/337] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:00.893829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa75a1-5bd5-4a2a-b461-c5ba87832738 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:00.894412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa75a1-5bd5-4a2a-b461-c5ba87832738 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:00.894873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa75a1-5bd5-4a2a-b461-c5ba87832738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:00.940564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-bdaa75a1-5bd5-4a2a-b461-c5ba87832738 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:00.942202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bdaa75a1-5bd5-4a2a-b461-c5ba87832738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:01.014346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.040661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a368-4346-4357-af9f-f4402bc620bc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.081869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.082540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.082816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.083089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.094423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1ea5a323-9eef-41f1-bb00-d4690efa8fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:01.102312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:01.103314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:01.104260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:01.104900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 173/338] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:01.109477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78605b-557a-48d8-aee3-3094e5b61ceb None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.109477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78605b-557a-48d8-aee3-3094e5b61ceb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.109477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78605b-557a-48d8-aee3-3094e5b61ceb None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.109477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 174/339] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:01.116194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78605b-557a-48d8-aee3-3094e5b61ceb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.129018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 166/340] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:01.130331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.130620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.130901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.167552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:01.168814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:01.262685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78605b-557a-48d8-aee3-3094e5b61ceb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.273018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.292953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 167/341] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:01.295458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.343895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.344906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.345397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.345876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.346809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:01.347312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:01.348924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:01.366629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.381308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 175/342] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:01.382480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.449289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5f6c8-381b-47d4-9391-23fb7bc8afe0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.523138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e71b0-d756-4f3b-853e-73fe860cd9a0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.565882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.566560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.566848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.567126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.567346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.568214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.568494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.568767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.580515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:01.586903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:01.587823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:01.588607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:01.590209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 176/343] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:01.591156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.604050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0ff868c6-35c2-4747-b63b-cafd14de69ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:01.609651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:01.610566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:01.611425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 168/344] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:01.616574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44ff6-32d2-4898-b686-e9213ef23d88 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.616855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44ff6-32d2-4898-b686-e9213ef23d88 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.617129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44ff6-32d2-4898-b686-e9213ef23d88 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.624203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 169/345] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:01 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:01.624203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44ff6-32d2-4898-b686-e9213ef23d88 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.671481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.726652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.729922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be175b-4e0a-4a73-bdcc-99c28cbff21e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.773066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.773940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.774265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.774643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.793011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44ff6-32d2-4898-b686-e9213ef23d88 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.839786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:01.841074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.841764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.842201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:01.843236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:01.843711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:01.845899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:01.854589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:01.856458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeefe9e-6dbf-41c2-b30c-278dabee4e3d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:01.859812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 170/346] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:01.861733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:01.951777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:01.983874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb95dd-d97c-4cb1-bf13-26064a7bc815 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:01.991296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 177/347] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:01.992681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:01.993328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:01.993452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.008197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.016602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:02.018075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:02.033036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.035951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.035951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.035951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.036304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:02.036568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.038504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.051655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 171/348] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:02.051655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.117230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 178/349] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:02.118396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.183938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b78ce-519b-4c15-812e-cd68aa0333ab None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.225878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.226251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.226513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.226799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.227137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.241562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c31d0-f004-44b2-b4cd-20b1403a7d19 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.278039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.282547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.283485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.283591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.283828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.287481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.287904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.291540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 179/350] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:02.291540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.305515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.307139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112477aa-73a6-4ab7-a227-2f50b29f3290 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.403686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7505-7567-4bba-879d-7122f94e1de1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.421160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 172/351] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:02.422599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8512-2a55-4c5d-9fa9-47bce4e4dcf6 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.422889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8512-2a55-4c5d-9fa9-47bce4e4dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.423164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8512-2a55-4c5d-9fa9-47bce4e4dcf6 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.427448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 173/352] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:02.427448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3277-a69a-4deb-817e-dbceec933517 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.427448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3277-a69a-4deb-817e-dbceec933517 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.427448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3277-a69a-4deb-817e-dbceec933517 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.427786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 174/353] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:02 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:02.428464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3277-a69a-4deb-817e-dbceec933517 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.448945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.449450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.449740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.450020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.485123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.518918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.538735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.540200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.546239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3277-a69a-4deb-817e-dbceec933517 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.587331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.588028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.588308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.588580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.603175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:02.608229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:02.609176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:02.609964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 175/354] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:02.610650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.669731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 180/355] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:02.670707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.728681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5c40-d397-42a1-ba3e-1ae18d75f723 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.736126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.767236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.768041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.768316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.768586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.772603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:02.775861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.778756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f821186-6732-42c0-a57c-1b715cf85220 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.781219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 176/356] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:02.782311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.782594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.782864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.787085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe205-4820-4d3b-975f-e07fc83c24df None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:02.803095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:02.804670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:02.831004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:02.831719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.832010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.832286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.833475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:02.834931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c99c4-9573-4fd5-bfe4-cf2496c5cb66 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:02.836695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 181/357] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:02.837844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:02.838131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:02.838405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:02.862122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:02.863311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:02.886742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 177/358] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:02.887492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:02.954037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 182/359] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:02.955404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.020913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e3d30-28dd-4165-97f7-5b520b66ed71 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.025681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.055670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.063175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.064017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.064300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.064575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.065320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:03.065634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.067037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.077099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 178/360] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.077721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13c91-85b9-49bf-bb38-6b250b38f5fb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.078137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.116889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.117549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.117830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.118101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.119343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.121127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.122971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 183/361] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:02 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.123885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.213815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ae570-7a5c-4532-a6ab-a48691eb9d04 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.247139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd558d2-d68e-499d-9755-ec7daea7551b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.253507 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.254301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.254414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.254663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.255493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=cd783f0145474a5f850e2646d2e4c37e) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:03.255802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.257250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.267396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 179/362] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 261 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.267396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.280857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.296343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.297027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.300434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.300434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.300434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.300735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.302222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 184/363] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.303035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.360654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.411372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248f97f-60bf-4468-b877-abb55a89f7fd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.440499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649c6ce-d475-42eb-b762-f0f1da8f20eb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.453776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.454880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.455512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.455856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.468731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:03.474517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:03.475454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:03.476260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 180/364] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:03.477521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.477849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.479899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.481407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.482719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.495973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:03.502097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:03.502965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 185/365] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:03.509038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.566320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.581681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc84a88-1c7f-4553-ac87-fe330d5d642d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.598704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.618993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.619597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.619934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.620215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] PATH_INFO: `/v3/users/a2abcd1bbe6b4500b6ff708afd67d874` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.622143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] RBAC: Authorizing `identity:get_user(user_id=a2abcd1bbe6b4500b6ff708afd67d874)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.622938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9362308-f18b-47af-a922-ca9e355a7d22 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.623635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.630085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 181/366] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/users/a2abcd1bbe6b4500b6ff708afd67d874 => generated 294 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.630085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.668498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.669452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.669739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.669999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.671180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.672670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.674455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 186/367] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.679972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.734245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e767-ff94-4a57-9aff-41728ff292cd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.769994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.770658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.770935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.771209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.772026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=cd783f0145474a5f850e2646d2e4c37e) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:03.772331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.773787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.779829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 182/368] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 261 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.787493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce6079-0ec3-4d62-8afd-501efffc3bb1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.789107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.811938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.838287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.839303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.839882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.840333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.842705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:03.843250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.844960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.857899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:03.863223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 187/369] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.863223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:03.925415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402fd4-6a1b-4894-bb71-d5faf3d4f2d8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:03.969505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:03.970626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:03.971161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:03.971650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:03.972574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:03.973093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:03.975205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:03.984926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 183/370] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:03.990616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.001831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb309-5ee7-4993-abd9-a51feebef6b6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.036595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.037220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.037501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.037774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.038916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] RBAC: Adding query filter params (role.id=5f4e804b30934e05a351efd607f4627a, user.id=a2abcd1bbe6b4500b6ff708afd67d874, scope.system=all) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:04.038916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.040308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.059550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 188/371] 10.222.0.100 () {56 vars in 1313 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/role_assignments?user.id=a2abcd1bbe6b4500b6ff708afd67d874&scope.system=all&role.id=5f4e804b30934e05a351efd607f4627a => generated 512 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:04.060593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.133329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.138601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee20d-daab-43f5-a448-2a8b3cbcb364 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.159513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.218173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.219276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.220534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.222308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.223705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=47bff2574c8741068a2fd649d3786455) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:04.224831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.226742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.232137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8d13-97e2-4b66-ae73-ff5b7de220e3 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.239306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 184/372] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:03 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 261 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:04.240383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.277260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.277762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.278048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.278327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.376060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.382401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.393926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf22f-8011-41e0-9ce5-03d216fc563f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.460861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.461773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.462218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.462634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.477230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.529244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.571511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.571511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.602357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 189/373] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:04.610281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.772544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c469-fbd8-4074-9420-a928df05f476 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.787061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 185/374] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:04.792841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.813046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.814275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.814696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.815186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] PATH_INFO: `/v3/projects/abb569dd63634bd9bd1193603cb21bb9` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.816633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] RBAC: Authorizing `identity:get_project(project_id=abb569dd63634bd9bd1193603cb21bb9)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.818242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.820429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 190/375] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/projects/abb569dd63634bd9bd1193603cb21bb9 => generated 345 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:04.826639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:04.846592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.909340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:04.938840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32478ecd-4cd5-4da2-8ba6-6975d80057e8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:04.976021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:04.976681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:04.976965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:04.977243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:04.979567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:04.981110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:04.983170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 186/376] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:04.988598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:05.018793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab624-afdb-406a-85cf-a095b6aa9b38 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:05.100684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d351-be65-4cc5-b22d-4db78d574d26 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:05.102922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:05.103631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.103918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.104194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] PATH_INFO: `/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.116968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] RBAC: Authorizing `identity:get_group(group_id=74e6a949007e4a2c8fad81f70dd2afb2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:05.118462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:05.120225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 191/377] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2 => generated 230 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:05.132540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:05.181052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:05.181728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.182010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.182286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.184360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:05.185829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:05.187907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 187/378] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:04 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:05.193938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:05.219931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:05.281729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:05.346369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee934-5689-477a-b539-c66e99b3cf43 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:05.390370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:05.391261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0dab-6d81-46b2-842e-2164617797af None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:05.391586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.392069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.392559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.393713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] RBAC: Adding query filter params (group.id=74e6a949007e4a2c8fad81f70dd2afb2, role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=abb569dd63634bd9bd1193603cb21bb9) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:05.394216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:05.395888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ef40-d228-4952-835c-d353a366c253 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:05.412905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 192/379] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:05 2022] GET /identity/v3/role_assignments?group.id=74e6a949007e4a2c8fad81f70dd2afb2&scope.project.id=abb569dd63634bd9bd1193603cb21bb9&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 261 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:05.440478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:05.441470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.441955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.442433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.443488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=47bff2574c8741068a2fd649d3786455) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:05.443987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:05.445608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89413e-4dec-42de-a510-aa78055ae202 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:05.452563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 188/380] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:05 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 261 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:05.620017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587c484-ac36-4163-bd0c-5060ef7390ac None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.620910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587c484-ac36-4163-bd0c-5060ef7390ac None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.621545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587c484-ac36-4163-bd0c-5060ef7390ac None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.623644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 193/381] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:05.628990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.629581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.630067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.656455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:05.658089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:05.737734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 189/382] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:05.771824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587c484-ac36-4163-bd0c-5060ef7390ac None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:05.902039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587c484-ac36-4163-bd0c-5060ef7390ac None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:05.950066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:05.951094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:05.951587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:05.952045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:05.956874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:05.976021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:05.981713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:05.982600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:05.983417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:05.984021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 194/383] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:05.988900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.008110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:06.136855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676b2a-b194-45ba-b549-5a915feebc91 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.172439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.173066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.173386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.173662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.174386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] RBAC: Adding query filter params (name=member) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:06.174695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:06.176118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7192e-edc0-4493-9eb9-b174210d9518 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:06.185215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 190/384] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:06.190443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.211474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750716de-b658-4c8a-8e78-2e4ff8e22c0f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.212101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750716de-b658-4c8a-8e78-2e4ff8e22c0f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.212572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750716de-b658-4c8a-8e78-2e4ff8e22c0f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.214400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 191/385] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:06.220430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.220979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.221469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.241490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:06.243022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:06.313060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:06.323308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 192/386] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:06.349412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.392397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1257b0-71c6-4ae6-8842-488f72f1302c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.449067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.449736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.450091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.450505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.452532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:06.454828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:06.465141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 195/387] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:06 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:06.469003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.554669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840586e-ad39-400b-9b6a-204332f33784 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.599719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:06.625516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.626178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.626458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.626732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.648304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:06.653517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:06.654480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:06.655290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:06.659695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 193/388] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:06.665296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b623-53dc-452a-a543-5f00a2ad4516 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.667704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.732486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.733067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.733349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.733624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.735578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:06.737045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:06.747763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 196/389] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:06 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:06.750762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.770039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:06.822304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe31c-af6a-42d5-8085-a602e54b0545 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.871416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.872365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.872647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.872920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.873662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:06.873971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:06.876432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7d285-89ab-4ffb-92ec-d33b3672ef37 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:06.892034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 194/390] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:06 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:06.894181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e67c8-8f70-4b82-a1ce-6f400fc1b61b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.894467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e67c8-8f70-4b82-a1ce-6f400fc1b61b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.895005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e67c8-8f70-4b82-a1ce-6f400fc1b61b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.899276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 195/391] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:06.900129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e67c8-8f70-4b82-a1ce-6f400fc1b61b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:06.919521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24413-b84d-462d-8914-8cfed939e854 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:06.957731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:06.970439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:06.971276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:06.971713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:06.972003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:06.974624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, group_id=0b7ce6f98f5f485ebfe4578cd961b975, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:06.976366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6f7cc-f9c3-4f1a-8742-4bcf5440deb1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:06.999521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 197/392] 10.222.0.100 () {58 vars in 1447 bytes} [Fri Aug 5 20:31:06 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:07.001227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.001695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.002144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.034346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:07.037759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:07.045437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e67c8-8f70-4b82-a1ce-6f400fc1b61b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.078744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:07.110941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.111646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.111932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.112205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.114276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:07.120044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:07.123852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 196/393] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:06 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:07.129494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.201833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 198/394] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:07.226948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.257401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f5283-12a7-4467-9c5e-b8984308fb2c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.297011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.298090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.298542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.299070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.300454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:07.302251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:07.304669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 197/395] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:07 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:07.312483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.363857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de301c43-ee16-470e-9f13-0ee33af710e5 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.373570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:07.414259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:07.428735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4a407-da2e-4e75-bdf9-2958d4622a9a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.440064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.440837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.441195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.441543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.468404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:07.469494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.470371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.470820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.471260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.473797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd783f0145474a5f850e2646d2e4c37e, group_id=0b7ce6f98f5f485ebfe4578cd961b975, role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:07.473921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:07.474728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:07.475655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:07.478287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:07.479696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 199/396] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:07.483063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.494920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 198/397] 10.222.0.100 () {58 vars in 1447 bytes} [Fri Aug 5 20:31:07 2022] PUT /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:07.631843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a43b9-bfed-4f2c-a818-98c38030f739 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.675013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.675694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.675980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.676259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.677002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:07.677313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:07.678710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83748615-83ee-4b3e-9350-9bef3be4e321 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:07.688197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 200/398] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:07.693645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.853374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7965f7-236c-4ca9-bc83-e83a74215ab1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:07.872798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:07.901136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:07.901712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.902059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.902335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.904105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:07.905559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:07.907671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdced25-cba8-408d-affa-f02bd22a2c37 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.907843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 199/399] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:07 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:07.907978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdced25-cba8-408d-affa-f02bd22a2c37 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.908258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdced25-cba8-408d-affa-f02bd22a2c37 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.909770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 201/400] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:07.914743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5ee-bf7f-49fe-8328-34d2a4d01d22 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:07.915033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5ee-bf7f-49fe-8328-34d2a4d01d22 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:07.915317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ec5ee-bf7f-49fe-8328-34d2a4d01d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:07.915553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:07.942731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ce7ec5ee-bf7f-49fe-8328-34d2a4d01d22 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:07.944071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ce7ec5ee-bf7f-49fe-8328-34d2a4d01d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:07.997236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.035530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 202/401] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:08.036885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab481-e03c-46eb-8b2e-316bf0f37d89 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.037174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab481-e03c-46eb-8b2e-316bf0f37d89 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.037455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab481-e03c-46eb-8b2e-316bf0f37d89 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.039039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 203/402] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:08.045649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.045931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.046209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.061016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f790-0485-4934-8cd8-d6ecd8a642aa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.075182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:08.076418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:08.103771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.104778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.105430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.105748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.107699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:08.109627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:08.111886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 200/403] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:07 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:08.112728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.150988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 204/404] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:08.152003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.190844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.244277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33661e-5e90-4dfc-af12-b9aae7244cdf None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.282907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.283441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb6e7c-c701-4af8-890e-ce0f71d94041 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.284048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.284472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.284885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.286506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.297852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:08.304003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:08.304999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:08.305777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:08.311828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 201/405] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:08.312964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.324145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.324947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.325410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.325755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.328342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, group_id=0b7ce6f98f5f485ebfe4578cd961b975, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:08.330531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:08.351184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 205/406] 10.222.0.100 () {58 vars in 1447 bytes} [Fri Aug 5 20:31:08 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:08.359413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.538344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe3ef-f924-48ca-960f-c261f27ad5b4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.551746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.561675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69204db-bc0e-4e6b-833a-15d7bbce1460 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.582878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.583832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.584256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.584701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.598097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:08.602417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.603221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.603763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.604014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.604850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:08.605466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:08.605739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:08.606658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:08.607527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:08.608154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:08.610901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 202/407] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:08.616270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.623508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 206/408] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:08.629605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.685414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.760217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc276c7-c609-4111-b142-ed79e06887ac None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.803699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.804668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.805145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.805610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.807222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:08.807780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:08.809983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:08.821783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 203/409] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:08.828732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:08.862454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58784f-3049-460f-bd6f-f0136a57ffc1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:08.894561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:08.921155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:08.921831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:08.922116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:08.922394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] PATH_INFO: `/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:08.924339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] RBAC: Authorizing `identity:get_group(group_id=74e6a949007e4a2c8fad81f70dd2afb2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:08.926765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:08.928468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 207/410] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2 => generated 230 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:08.938911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:09.057766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711d91-88f0-4986-a5e5-fe0d7600df95 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.123092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.124492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.124914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.125421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.127157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:09.128798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:09.132009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 204/411] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:09.150581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:09.170785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:09.182937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405903-8445-46eb-8f9c-96e40dcdbceb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.251571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.252492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.252914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.253452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] PATH_INFO: `/v3/projects/abb569dd63634bd9bd1193603cb21bb9` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.255100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] RBAC: Authorizing `identity:get_project(project_id=abb569dd63634bd9bd1193603cb21bb9)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:09.256811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:09.259063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 208/412] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:08 2022] GET /identity/v3/projects/abb569dd63634bd9bd1193603cb21bb9 => generated 345 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:09.266104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:09.327881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:09.336764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2280-3d24-4db0-8821-2f77c7c931f6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.405459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.406199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.406486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.406824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.415379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:09.415379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:09.416503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 205/413] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:09 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:09.423000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:09.481970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeb44b-ff9e-4eec-9159-1b22414f47a0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.518951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.519694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.521013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.521298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] PATH_INFO: `/v3/projects/abb569dd63634bd9bd1193603cb21bb9/groups/74e6a949007e4a2c8fad81f70dd2afb2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.525392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=abb569dd63634bd9bd1193603cb21bb9, group_id=74e6a949007e4a2c8fad81f70dd2afb2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:09.526951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917758aa-bcd5-4e8a-ae03-15609df344c0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:09.553143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 209/414] 10.222.0.100 () {58 vars in 1447 bytes} [Fri Aug 5 20:31:09 2022] PUT /identity/v3/projects/abb569dd63634bd9bd1193603cb21bb9/groups/74e6a949007e4a2c8fad81f70dd2afb2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:31:09.602853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a771a-f572-4559-b996-f29f17c91734 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.641742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f6e3-a40f-4954-a669-e8229b584615 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.642079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f6e3-a40f-4954-a669-e8229b584615 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.642319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f6e3-a40f-4954-a669-e8229b584615 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.643780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 210/415] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:09.645557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.646405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.646792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.647170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.650191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.650477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.650753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.658881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] RBAC: Authorizing `identity:create_grant(project_id=47bff2574c8741068a2fd649d3786455, group_id=0b7ce6f98f5f485ebfe4578cd961b975, role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:09.661830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:09.682590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 206/416] 10.222.0.100 () {58 vars in 1447 bytes} [Fri Aug 5 20:31:09 2022] PUT /identity/v3/projects/47bff2574c8741068a2fd649d3786455/groups/0b7ce6f98f5f485ebfe4578cd961b975/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:09.686877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:09.688176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:09.728528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:09.795791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 211/417] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:09.824185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:09.857975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:09.935865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cebf0-8b3e-48eb-b258-4c31f55d1200 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:09.976902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:09.977688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:09.977977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:09.978259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:09.989630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-2623eb41-8219-4a5d-ac36-0d086c8d6cb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:09.995216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:09.996160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:09.996955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 207/418] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:10.002623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.124708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888727-3f9c-4c31-8bee-2f28eaa88312 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:10.126897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ab7-41fe-4dd5-8ad7-236dd0ddbac5 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.127348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ab7-41fe-4dd5-8ad7-236dd0ddbac5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.127457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ab7-41fe-4dd5-8ad7-236dd0ddbac5 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.129081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 208/419] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:10.136868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.137325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.137614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.166211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:10.166845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.167127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.167427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.168246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:10.168523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:10.168693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:10.169731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:10.169934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:10.183961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 212/420] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:10.186197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.205105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:10.299170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2edbee-accf-4a80-a5f9-5c05e1ccda01 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:10.308557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 209/421] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:10.357037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:10.357368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.357674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.357960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.358239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.395834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:10.442624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:10.444264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:10.462033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:10.554427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5354c-c135-46fb-b1b9-981b6057ab90 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:10.596633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 213/422] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 20:31:10.602420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.615037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:10.616023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.616445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.616855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.643390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:10.648843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:10.649892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:10.650903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:10.659073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 210/423] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:10.663978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.790894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44ee3-f645-43c5-abe9-0152e7d4ca5c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:10.815338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:10.832460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:10.833451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.833931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.834503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.835945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:10.838031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:10.842769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 214/424] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:10.848783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.855739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:10.893271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ab73b-3e3c-47bb-8b78-6c7950e31910 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:10.941775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:10.942321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.942599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.942864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.944308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:10.944612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:10.946013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac273b2-1bf4-4cf2-9971-51f65915572b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:10.963609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 211/425] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:10.966107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ba7c-e6d9-4d01-89de-4958710adc54 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:10.966107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ba7c-e6d9-4d01-89de-4958710adc54 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:10.966240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ba7c-e6d9-4d01-89de-4958710adc54 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:10.971772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 212/426] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:10.973639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ba7c-e6d9-4d01-89de-4958710adc54 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:10.985902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfe8d8-81c7-4dcd-b3d3-41bc52dadae1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.022395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.023081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.023389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.023669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.024835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.026307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d864-ae2a-4d62-b100-93db60877355 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.032821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 215/427] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:11.032821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.032821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.032821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.048937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:11.050189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:11.099484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.106002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ba7c-e6d9-4d01-89de-4958710adc54 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.123563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 216/428] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:11.131645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.163834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.164460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.165083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.165429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.180182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.253407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246a450-3f5e-4f5b-8ca1-2470daa92677 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.254715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.257302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.293142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.294017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.294347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.294693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.295605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=cd783f0145474a5f850e2646d2e4c37e) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:11.295983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.297646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.303944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 217/429] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 613 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:11.311710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.402646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.454873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 213/430] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 20:31:11.462107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.491081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2991-8c27-4d2c-9715-fe5dcec22d2c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.532492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.546127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.546636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.546922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.547203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.558572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:11.565291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:11.566493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:11.567582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 218/431] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:11.571902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.600057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429ce1-6369-476f-887f-7fac0e09c0eb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.638184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.639186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.639742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.640176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] PATH_INFO: `/v3/projects/cd783f0145474a5f850e2646d2e4c37e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.641641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd783f0145474a5f850e2646d2e4c37e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.643270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.649745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 214/432] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/projects/cd783f0145474a5f850e2646d2e4c37e => generated 299 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:11.652408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.687103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776ddd-d994-474f-84a6-4e822a718e35 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.689943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.729536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.730467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.730757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.731025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.732205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] RBAC: Adding query filter params (name=member) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:11.732530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.734185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.747083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 219/433] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:11.752881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.787100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7de0e-cec7-4c5d-862d-ee208fb63fe6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.802828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:11.842578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.843238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.843629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.843907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.845073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:11.846778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd2c9-95d3-429b-a957-7e21cdff4080 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:11.853046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 215/434] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:11.859924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c211a-6139-4729-bc69-b9b037f410de None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.860341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c211a-6139-4729-bc69-b9b037f410de None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.860626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c211a-6139-4729-bc69-b9b037f410de None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.862110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 216/435] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:11.862673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c211a-6139-4729-bc69-b9b037f410de None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:11.894385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc2c0-5175-497d-baa5-a0f086b0c353 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:11.935942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:11.936938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:11.937421 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:11.938150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:11.988833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.013156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c211a-6139-4729-bc69-b9b037f410de None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.033908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.036730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ac24b-fd97-4012-aee6-1287fc91214c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.054779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.055332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.055646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.055916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.056714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=cd783f0145474a5f850e2646d2e4c37e) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:12.057032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.058674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738914b-3141-4b3c-b3ec-4912fed30367 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.065254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 217/436] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=cd783f0145474a5f850e2646d2e4c37e&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 613 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.066406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb496-0d8c-4cb8-b759-aaa5c97a6849 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.066688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb496-0d8c-4cb8-b759-aaa5c97a6849 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.066960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb496-0d8c-4cb8-b759-aaa5c97a6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.088893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d07bb496-0d8c-4cb8-b759-aaa5c97a6849 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:12.090713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d07bb496-0d8c-4cb8-b759-aaa5c97a6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:12.139829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.179335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 218/437] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:12.191407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c09db-e562-47cf-8e36-eab3e67b6b88 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.191407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c09db-e562-47cf-8e36-eab3e67b6b88 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.191407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c09db-e562-47cf-8e36-eab3e67b6b88 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.191407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 219/438] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:12.191816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 220/439] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:12.196729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c09db-e562-47cf-8e36-eab3e67b6b88 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.198556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.199336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.200077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.221056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:12.223163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:12.294603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.303392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 221/440] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:12.304412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.318259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c09db-e562-47cf-8e36-eab3e67b6b88 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.362040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.363039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.363578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.364050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.365443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.366964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.373016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 220/441] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.373016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.415840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.426238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c438f-616c-462a-9af3-9a09ed9a1d3c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.462443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.463099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.463398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.463672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.474285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:12.479300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:12.480661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 222/442] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:12.481464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.489289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeef165-7825-469f-bf84-ed294832f9aa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.525930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.526576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.526918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.527186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.537925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:12.540565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:12.543263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:12.544294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:12.545117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 221/443] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:12.545779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.587346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830410-a2ee-4d20-825b-316e34eeb470 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.622131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.622776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.623060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.623334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.624553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.626032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.627665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 223/444] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.628426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.645141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.649796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6291-9ce8-4e49-8657-7f17f18ae922 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.684515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.685139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.685422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.685699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.686432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:12.686738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.688159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.696405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 222/445] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.697230 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2a87-14dc-416f-87ac-7fdf04cbfce5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.751320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.762280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.762904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.763185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.763506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.764270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:12.764556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.765933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.774109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 224/446] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.774890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.801241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01a1c-7af5-4722-aadc-d2074b14d7b6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.835795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.836416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.836703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.836981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.837839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=f471e7fbe9e344549f74ea85c7fa0fe1, scope.project.id=47bff2574c8741068a2fd649d3786455) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:12.838102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:12.839622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:12.845348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 223/447] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=f471e7fbe9e344549f74ea85c7fa0fe1 => generated 613 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:12.846129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:12.882993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:12.885523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bd77-8763-44a1-8288-118d3302501f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.925193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:12.925937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:12.926229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:12.926514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:12.979437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eccb7f-e341-4fb1-a86f-2cfdf6442d6e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:12.991663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.008514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.010003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.022138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.022776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.023266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.023395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.103089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.105110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.127920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 225/448] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:13.133693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.134800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.221855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 224/449] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:13.225302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.227641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.240898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41efd-3411-41d2-8156-bf23c3c114a4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.275789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.276446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.276787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.277078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] PATH_INFO: `/v3/projects/abb569dd63634bd9bd1193603cb21bb9` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.278283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] RBAC: Authorizing `identity:get_project(project_id=abb569dd63634bd9bd1193603cb21bb9)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.279766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.281722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 226/450] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/projects/abb569dd63634bd9bd1193603cb21bb9 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:13.287292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.330573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dac63-c4f3-4026-8571-a5371f0edc67 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.354087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.365798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.366615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.366897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.367169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] PATH_INFO: `/v3/projects/47bff2574c8741068a2fd649d3786455` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.368635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] RBAC: Authorizing `identity:get_project(project_id=47bff2574c8741068a2fd649d3786455)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.370076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.372267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 225/451] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/projects/47bff2574c8741068a2fd649d3786455 => generated 303 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:13.377820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.390991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec37f4-1b35-4103-8fde-eeedf7777dcc None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.425204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.425849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.426131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.426406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] PATH_INFO: `/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.427595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] RBAC: Authorizing `identity:get_group(group_id=74e6a949007e4a2c8fad81f70dd2afb2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.429034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.430634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 227/452] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/groups/74e6a949007e4a2c8fad81f70dd2afb2 => generated 230 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:13.436688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.460900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.478085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9282b6-1904-41d5-8ca5-a53958cc1b0d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.511937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.512600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.512883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.513156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] PATH_INFO: `/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.514294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] RBAC: Authorizing `identity:get_group(group_id=0b7ce6f98f5f485ebfe4578cd961b975)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.515785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.517380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 226/453] 10.222.0.100 () {56 vars in 1185 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/groups/0b7ce6f98f5f485ebfe4578cd961b975 => generated 227 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:13.523287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:13.541154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f38fe-4c94-42fa-aa26-b6686bdee2cd None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.575815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.576441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.576726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.576994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.577959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] RBAC: Adding query filter params (group.id=74e6a949007e4a2c8fad81f70dd2afb2, role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=abb569dd63634bd9bd1193603cb21bb9) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:13.578293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.579765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da39a7-c652-4bc5-ad7c-0f331556e0fe None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.583131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:13.586109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 228/454] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/role_assignments?group.id=74e6a949007e4a2c8fad81f70dd2afb2&scope.project.id=abb569dd63634bd9bd1193603cb21bb9&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 613 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:13.628702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a523-ee3f-48e7-b0b9-59cb0b536095 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:13.668340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:13.668993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:13.669278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:13.669558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:13.670382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] RBAC: Adding query filter params (group.id=0b7ce6f98f5f485ebfe4578cd961b975, role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=47bff2574c8741068a2fd649d3786455) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:13.670707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:13.672214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06fe6-9c48-4a5c-940c-c60b4f20a530 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:13.679036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 227/455] 10.222.0.100 () {56 vars in 1381 bytes} [Fri Aug 5 20:31:13 2022] GET /identity/v3/role_assignments?group.id=0b7ce6f98f5f485ebfe4578cd961b975&scope.project.id=47bff2574c8741068a2fd649d3786455&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 613 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:16.174749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78200-8ebe-4c82-bd24-78e4af8d17c0 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.175294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78200-8ebe-4c82-bd24-78e4af8d17c0 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.175294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78200-8ebe-4c82-bd24-78e4af8d17c0 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.177025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 229/456] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:16.182169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.182600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.182765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.208722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:16.209936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:16.297917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 228/457] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:16.334622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc888-d131-4c8a-9067-e7bb865f8950 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.334927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc888-d131-4c8a-9067-e7bb865f8950 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.335182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc888-d131-4c8a-9067-e7bb865f8950 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.336819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 230/458] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:16.337951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:16.341987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.342278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.342561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.372366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:16.373591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:16.444996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:16.507174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 231/459] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:16.516355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697360c-3a6d-4baa-89c2-5c78c0c8700c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:16.550186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:16.550752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.551027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.551296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.557575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:16.573698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:16.575576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:16.582643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:16.602583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:16.603545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:16.604369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:16.604369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:16.604369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:16.604369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:16.604369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 229/460] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:16.610712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:16.750137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f4366-0272-48fa-93de-6f0cbb54c8a6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:16.771211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b867df-8fb2-4028-a4a5-fffe6f6488ee None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:16.779078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:16.826776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:16.828354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.829028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.830036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.838542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:16.839924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:16.842864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:16.843344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:16.844277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:16.844794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:16.846378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:16.850986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:16.852732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:16.879815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:16.880722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:16.881537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:16.881537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:16.881537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:16.881537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:16.882471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 230/461] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:16.883589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:16.889344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 232/462] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:16.896217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.000112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f1c02-cdb2-41cf-ba66-949fb4d96444 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.024335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.043971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.044703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.044987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.045260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.045950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.047450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395b835-a83b-4f9c-af47-d0b18a9f5650 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.060275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b3f7-4ecd-424a-8e7a-1ebe7aa88eef None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.071532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 231/463] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:16 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:17.073048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7705-7d42-4361-9a8f-75d27032cec2 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.073385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7705-7d42-4361-9a8f-75d27032cec2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.073695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7705-7d42-4361-9a8f-75d27032cec2 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.076013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 232/464] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:17.096889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db4ca-809a-4072-9dd8-989ec1c830eb None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.097079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db4ca-809a-4072-9dd8-989ec1c830eb None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.097358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db4ca-809a-4072-9dd8-989ec1c830eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.103438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.104143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.104367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.104645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.105435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:17.105745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.107527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.132363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 233/465] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:17.133892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.137748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7d3db4ca-809a-4072-9dd8-989ec1c830eb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:17.139222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7d3db4ca-809a-4072-9dd8-989ec1c830eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:17.173144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.243943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86956f4-a609-49c4-8e49-6a778d30c523 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.273826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 233/466] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:17.275224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b05d6-70b2-4b18-8347-6f230ff36387 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.275548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b05d6-70b2-4b18-8347-6f230ff36387 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.275829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b05d6-70b2-4b18-8347-6f230ff36387 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.276096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.281346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 234/467] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:17.282529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9990-c5cc-433b-8674-0172bb318feb None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.282818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9990-c5cc-433b-8674-0172bb318feb None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.283099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c9990-c5cc-433b-8674-0172bb318feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.290018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.291101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.291632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.292082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.293029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.294824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.302569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d15c9990-c5cc-433b-8674-0172bb318feb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:17.304016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d15c9990-c5cc-433b-8674-0172bb318feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:17.326053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 234/468] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:17.326929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.392953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 235/469] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:17.394198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4ce-7573-4776-8393-6cdde1b5e82f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.394488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4ce-7573-4776-8393-6cdde1b5e82f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.394770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f4ce-7573-4776-8393-6cdde1b5e82f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.400971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 236/470] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:17 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:17.406882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.407229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.407540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.431031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:17.433329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:17.478265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e1a8-94ed-4a0b-83ad-a64c496b620d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.517602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.518650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.519225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.519570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.523785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 237/471] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:17.524608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.540018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.542158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.542296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:17.560707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:17.561662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:17.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:17.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:17.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:17.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 235/472] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:17.562766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.606997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.654790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe198-7786-4ae7-b00b-993a1b57a295 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.691783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.692796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.693266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.693702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.701601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7536c8-b515-4481-b3be-efef14f5b6b3 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.704972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.706762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:17.724129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:17.725007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:17.725824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:17.725824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:17.725824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:17.725824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:17.727752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 238/473] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:17.728696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.743511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.744531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.744817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.745104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.746595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.748774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.757782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.sql.core [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 20:31:17.757782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 20:31:17.757782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [parameters: {'id': '13c163a63a6246158d5b78f91cad3784', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 20:31:17.757782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result.read() Aug 05 20:31:17.777028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:31:17.778067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application yield resource Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise self.value Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application session.commit() Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 20:31:17.778985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.session.flush() Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application compat.raise_( Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 20:31:17.779885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:31:17.781558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result.read() Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:31:17.783518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [parameters: {'id': '13c163a63a6246158d5b78f91cad3784', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:17.785750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 20:31:17.787974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:17.790810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 236/474] 10.222.0.100 () {60 vars in 1136 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:17.790810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.830538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.875472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc2b48-c7bc-46e2-907a-6ab88de69ad3 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.910775 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:17.911997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.912523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.912827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.913145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.913925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:17.914224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.915687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.918973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1f8d1-9603-48ed-aad9-bea25925b7c7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:17.928598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 239/475] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:17.934251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:17.968233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:17.969824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:17.970470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:17.971104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:17.972279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:17.973239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:17.975339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:17.990059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 237/476] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:17.991240 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:18.049556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960365-5bd2-4cbc-9900-7e9df7f57c16 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:18.074017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:18.086450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:18.087098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:18.087387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:18.087737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:18.098566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:18.101812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701add9-adc0-4e39-8b5c-bfbbf9290034 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:18.103553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:18.104540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 20:31:18.105839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:18.109932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 240/477] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:18.110790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:18.143757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:18.144778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:18.145288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:18.145751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:18.146760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:18.148625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:18.174366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 238/478] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:17 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:18.175671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:18.198186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:18.302143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1de557-a2c7-4f78-8131-d7abaf40d84a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:18.305413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20100bbb-70c9-4b62-a9bb-4aff51330490 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:18.344135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:18.345219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:18.345743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:18.346252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:18.347192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:18.347712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:18.349458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10726-5282-4bce-bcc1-9e9fc8d80e78 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:18.360171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 239/479] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:18.381473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:18.382504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:18.382979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:18.383476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:18.384378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:18.386152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4cb50-d42c-4ba7-b536-93850e451225 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:18.412166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 241/480] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:18 2022] POST /identity/v3/users => generated 250 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:19.545524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff36c7-fdb3-41a6-942d-a5a84ae525d8 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:19.546047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff36c7-fdb3-41a6-942d-a5a84ae525d8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:19.546119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff36c7-fdb3-41a6-942d-a5a84ae525d8 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:19.547700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 240/481] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:19.553157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ddbd8-a825-4f3d-9196-5fbf77f4bd35 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:19.553573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ddbd8-a825-4f3d-9196-5fbf77f4bd35 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:19.553738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ddbd8-a825-4f3d-9196-5fbf77f4bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:19.572376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b83ddbd8-a825-4f3d-9196-5fbf77f4bd35 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:19.573628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b83ddbd8-a825-4f3d-9196-5fbf77f4bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:19.609209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:19.654675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 242/482] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:19.688661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff36c7-fdb3-41a6-942d-a5a84ae525d8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:19.726738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafbed-d45b-4c83-8bef-6f07cc947957 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:19.727147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafbed-d45b-4c83-8bef-6f07cc947957 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:19.727333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafbed-d45b-4c83-8bef-6f07cc947957 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:19.728693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 243/483] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:19.734008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:19.734295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:19.734574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:19.759453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:19.760662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:19.824325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:19.866807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 244/484] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:19.872764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff36c7-fdb3-41a6-942d-a5a84ae525d8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:19.893060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:19.914659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:19.915327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:19.915630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:19.915908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:19.935452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:19.943058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:19.943991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:19.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:19.945414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 241/485] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:19.953046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.093159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.096781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7b39e-fa64-4266-8839-06fa9aa2eb44 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.132345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.133006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.133291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.133572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.144348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:20.149359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:20.150214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:20.150978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 245/486] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:20.154754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7041-a79c-4503-87b4-def5ee1785c9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.157734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.198213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.200336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.200797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.201807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.203449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:20.205056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.206656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.218832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.229803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 242/487] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:19 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:20.235308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.287647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96cbef-b303-458b-b285-06d247cdb575 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.324089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.324720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.325003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.325282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.326082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:20.326391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.327869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.337091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 246/488] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:20.342667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.392740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.419837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0547f-2f97-41ed-9107-69e2279b6133 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.465359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.466038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.466318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.466637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.486424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.492066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:20.510695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:20.511833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:20.512677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:20.512677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:20.512677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:20.512677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:20.513526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 243/489] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:20.520528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.531139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf845-4a35-4821-ad38-99ce07e9efa6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.573524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.575114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.575613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.576081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.598081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.601014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:20.626481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:20.627405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:20.628657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:20.628657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:20.628657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:20.628657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:20.628657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 247/490] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:20.634141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.642933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.720667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.747656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35267f9-d542-48fc-a623-d15e9d4ad2bb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.784460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.785094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.785684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.785959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.786668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:20.786971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.788397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.802002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 248/491] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:20.807349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.829946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a81a5-6c6c-42f0-a283-ca66146d9968 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.865212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.866200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.866680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.867252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.868112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:20.868431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.869804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3464-56b2-43f7-858d-5c7b36e19eb8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.882289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 244/492] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:20.883623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7779-76f6-4511-8414-b09b271898f2 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.883913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7779-76f6-4511-8414-b09b271898f2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.884193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b7779-76f6-4511-8414-b09b271898f2 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.885542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 245/493] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:20.886983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7eb83-7cb2-4052-ba82-d63740bce465 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.886983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7eb83-7cb2-4052-ba82-d63740bce465 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.887262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7eb83-7cb2-4052-ba82-d63740bce465 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.890899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 246/494] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:20 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:20.891945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7eb83-7cb2-4052-ba82-d63740bce465 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:20.927376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceed857-5308-48ea-8fbd-0101b3b8a274 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:20.972320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:20.972981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:20.973265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:20.973542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:20.976796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:20.982760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:20.984867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-d1ab413f-849a-473e-aaa2-10cba66eb1eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:20.998678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:21.004746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 249/495] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.005631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.006350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.015648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7eb83-7cb2-4052-ba82-d63740bce465 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.022706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:21.023951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:21.031238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.055451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.056100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.056379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.056654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.063897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.065349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-41acb24c-9cf0-4b32-9833-e3ada4fa4f93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:21.078496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:21.079543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 247/496] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2d38-fe48-41ff-a478-a9616bd7c386 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.085148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2d38-fe48-41ff-a478-a9616bd7c386 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.085920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2d38-fe48-41ff-a478-a9616bd7c386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.099453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-eece2d38-fe48-41ff-a478-a9616bd7c386 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:21.099977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 250/497] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:21.100643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-eece2d38-fe48-41ff-a478-a9616bd7c386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:21.100832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.174342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 248/498] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:21.175709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9536-9b9e-49af-a342-c25f6ebaf71d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.176002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9536-9b9e-49af-a342-c25f6ebaf71d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.176284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9536-9b9e-49af-a342-c25f6ebaf71d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.177588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 249/499] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:21.178226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9536-9b9e-49af-a342-c25f6ebaf71d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.213019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7182d4-58ae-4e17-a9eb-0a0b265a8374 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.236889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.248531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.249167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.249445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.249736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.250517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:21.250822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.252288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.282929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9536-9b9e-49af-a342-c25f6ebaf71d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.284516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.289235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 251/500] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:21.290074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.323325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.324169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.324455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.324730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.325537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:21.325856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.327338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec5167-5ebf-4ce0-af83-89d2f739341d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.367214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 250/501] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:21.368619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.368909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.369168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.387990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:21.389177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:21.396919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0193ef-042b-4a99-9d3a-8303d781eacb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.431963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.432534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.432855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.433208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.446119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:21.451378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:21.452435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:21.453260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 252/502] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:21.453922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.462973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 251/503] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:21.463853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.500710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.556519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc46c43-dcd0-4606-9bf2-056504f54370 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.565584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.576601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0bce-c77a-452b-b840-0e95d711b8d9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.592765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.593405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.593694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.593966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.604810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.606549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.612947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.613580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.613860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.614129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:21.622262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:21.623102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 253/504] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:21.624293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.687536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.688925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.717044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.723861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031530e-4dbd-4311-bcf7-c4f964d56587 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.757611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.758236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.758514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.758781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.782242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.793663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 252/505] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:21.794507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.828018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.829512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.894145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa387-04db-45e9-9131-4c78090eb73c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:21.921297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:21.928751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 254/506] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:21.929172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:21.929406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.929802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:21.930085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:21.930360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:21.931074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:21.931400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:21.932782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:21.941332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 253/507] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:21.942110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:21.999733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.035593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba15a-afb9-46ec-9c17-5aa5f428e953 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.053489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2f81-b776-457e-9a98-b17dcb168847 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.069684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.070329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.070612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.070887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.081428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:22.086499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.087583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 255/508] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.088652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.093531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.093531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.093531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.093839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.094534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:22.094839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.096253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.108952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 254/509] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:22.109773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.148608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.195704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda83a-ac3f-429c-805e-e8adfe1ab8c4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.212645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6e96-b432-4a6e-9322-612af2018d61 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.226602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.229441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.230314 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.230592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.230845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.241029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.242561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.248922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.249562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.249849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.250124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:22.257989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.258959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 256/510] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.259995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.260616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.262822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:22.280763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.281695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.282573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:22.282573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:22.282573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.282573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:22.282573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 255/511] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.283154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.365867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbe37-ea2e-4778-acbf-c39655851c38 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.373225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.391450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06b67-542c-42e2-89e8-5cb697d30285 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.400919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.401609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.401934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.402341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.413438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.414901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.426682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.427303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.427640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.427916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.428638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:22.428975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:22.429212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.430067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.430890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:22.430890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:22.430890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.430890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:22.431106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.431174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 257/512] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.431174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.439238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 256/513] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:22.440351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.469459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.536608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8a6a6-ae70-49da-bc4f-b737acb2a367 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.542320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ade173-8735-4e35-98b6-a3ecf2429432 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.570197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.570824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.571111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.571394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.572098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.573722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.575336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.575982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.576260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.576536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.577221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:22.577521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.578867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.597394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 257/514] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:22.597394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.608065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 258/515] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:22 2022] POST /identity/v3/users => generated 248 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:22.608065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.625790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.696562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.712738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b16-78f2-448f-a274-9358d296569e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.736755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b681f-8c3a-4724-b2e1-8fde843a3baa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.752511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.753150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.753440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.753721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.754433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:22.754737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.756194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.769193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 258/516] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:22.769865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.778936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.779605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.779890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.780168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.780885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:22.781190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.782613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.797001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 259/517] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:22.797704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.875588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.886359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339b42-799a-4848-8a3d-1ced8dfb496f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.903100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba031b-d7cb-4255-898e-c7c18aa201e3 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:22.924464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.925129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.925680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.925961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.937589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.939057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.939278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:22.939966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:22.940252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:22.940551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:22.946264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:22.947657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:22.949211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:22.955129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.955998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.956838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:22.956838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:22.956838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:22.956838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:22.963310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:22.964413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:22.965275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:22.966091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 259/518] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.967154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:22.968269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 260/519] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:22.968793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.072509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db742cb8-b124-4b04-980a-6d008de5480a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.073740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b7db5-1c3b-4bb0-aab1-22bbdc66e686 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.109656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.110311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.110597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.110694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.110881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.111256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.111571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.111854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.113162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.119099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.120159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.120613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.122010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:23.132705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:23.133567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:23.134401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:23.134802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:23.136255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:23.137166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:23.138825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 260/520] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:23.139744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.140340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 261/521] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:23.141194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.203894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.246099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ab54-e57f-4349-8e56-0874454f4c44 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.247888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e4e2a-69c6-4dd0-81a9-fd7794bd0600 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.282187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.282819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.283104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.283412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.283518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.284120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.284432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.284537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.284955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.285677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.286149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.286721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.287169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.289000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.298109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 262/522] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.298746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.315530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 261/523] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.316669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.361813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.425288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7419-b4ab-4569-8943-044775ca35d1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.427708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dddb-0ba0-4270-86f1-053eebe4b1c3 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.446228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.463214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.463906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.464275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.464664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.465229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.465444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.465802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.465906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.466136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.466417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.467218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.467306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.467559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.469001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.491060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 263/524] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.491060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.491350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 262/525] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.492179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.602029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b857ea-831a-461a-b0f9-a7abf1f7587e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.602640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be45ea9-be97-4d12-9d3d-443ddab5ac88 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.618675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.642191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.642881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.643005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.643217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.643585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.643701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.643886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.644164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.644399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=f1522c66319745588bc60119696076db) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.644712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.646188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.651835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 263/526] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/role_assignments?user.id=f1522c66319745588bc60119696076db&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.652637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.665410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.668390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:23.686950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:23.688156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:23.689252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:23.692190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 264/527] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:23.693947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.705129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.775905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc7a2-2f08-426c-a6ce-627a42350ddf None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.820239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.821047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.821601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.821816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.865173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cba501-a91b-49d8-b6e7-4acd878a79b0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:23.898797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.900570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.909045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:23.910562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:23.910916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:23.911263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:23.912186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:23.912577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:23.914950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:23.922949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 265/528] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:23.923991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:23.947615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:23.996537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:24.108436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 264/529] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:24.112213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.132287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4a0a4-6898-4ac1-805b-c59f7805cca8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.178706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.179322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.179629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.179960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.180785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:24.181100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.182570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.224882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 266/530] 10.222.0.100 () {56 vars in 1144 bytes} [Fri Aug 5 20:31:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:24.230574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.273018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bff8e-0742-4c7a-96c5-2b8c52994a13 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.346999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.347743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.348028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.348308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.363762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:24.375734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.377474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.387799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:24.399240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fdd92-0805-499a-a59e-b944b5a96a44 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:24.400090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:24.400912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:24.401956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:24.401956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:24.401956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:24.401956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:24.401956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 265/531] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:24.408793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.442139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.442688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.442972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.443246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.512812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.514316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.534769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a13c-fbc8-49e7-b1d2-748a5d7d9d38 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.572133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.572868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.573159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.573603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.574316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:24.574678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.576301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.589514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 266/532] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:24.600021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.627464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:24.638360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 267/533] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 20:31:24.644409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.699757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:24.772600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3f04a-9a3e-485d-a941-1918138aed76 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.806561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fa0fc-29ea-45ad-a485-e921077c7278 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.809301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.809986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.810273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.810555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.818384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.819964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e5ac5d78-c7a6-449a-bf06-b11ce4cf0dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:24.832158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:24.833035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:24.833851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 267/534] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:24.839383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff758b-9b5a-4f51-9f9c-b989094f7155 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.839383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff758b-9b5a-4f51-9f9c-b989094f7155 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.839383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff758b-9b5a-4f51-9f9c-b989094f7155 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.839383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 268/535] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:24.839383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff758b-9b5a-4f51-9f9c-b989094f7155 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:24.852593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:24.853672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.853965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.854395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.870521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:24.873075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-6eafd67b-a739-4da9-86e8-4559293848bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:24.894032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:24.895373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:24.896941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:24.896941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:24.896941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:24.896941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:24.896941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 268/536] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:24.897388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:24.899490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:24.899490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:24.922670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:24.924754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:24.959807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff758b-9b5a-4f51-9f9c-b989094f7155 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:24.973687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.001000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.001741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.002129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.002476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.003537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:25.003776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.005206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.005552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.023671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 269/537] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:25.023671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.049333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 269/538] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:25.051140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.129644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdb61a-672b-420a-b669-b6625782a8f1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.172796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.174003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.174840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.175448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.176392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:25.177093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.179345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.180763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682079-e118-496f-b976-9f94e3bb88de None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.194767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 270/539] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:25.195839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.222055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.222910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.223258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.223658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.224551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c2828c36b4144b0098071053b9436388) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:25.225033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.226565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.239383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 270/540] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/role_assignments?user.id=c2828c36b4144b0098071053b9436388&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:25.239383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.253885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.326611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.388768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183e-fed7-458b-a839-a647f8142b52 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.463467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.464233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.464645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.464974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.469588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b11aa-f0e0-4d13-98a1-e46ec4639e5b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.486452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:25.495408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:25.496404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:25.497192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 271/541] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:25.503209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.538682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.539339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.539640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.539912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.560592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.562177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:25.589002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:25.591012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:25.593053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 271/542] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:25.596007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.618446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.628276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7fdf-a1ae-406b-a045-caa20c3248fa None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.665030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.665658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.665943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.666328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.667178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:25.667683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.669384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.678335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 272/543] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:25.684632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.801964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc085-49f2-4ed3-97b5-0ca09cc3885e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.815524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f06c0-8d8c-4003-954d-6e1326f1d93b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:25.817801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.837220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.837883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.838168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.838442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.849914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.851392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5a9806ac-199e-4d32-a5a4-e17bc8fc1fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:25.866629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:25.867740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:25.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:25.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:25.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:25.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:25.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 273/544] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:25.869028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a083-d197-42a4-9962-4224b88e77f0 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.869301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a083-d197-42a4-9962-4224b88e77f0 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.869577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a083-d197-42a4-9962-4224b88e77f0 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.871404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 274/545] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:25.874806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a083-d197-42a4-9962-4224b88e77f0 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:25.886964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:25.894606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:25.896164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.896717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.897191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.898423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:25.899289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:25.901000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61143f-9f2b-466e-b2d0-9545aedd7bf9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:25.915683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 272/546] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:25.917121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:25.917534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:25.917985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:25.935965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:25.937452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:25.993569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a083-d197-42a4-9962-4224b88e77f0 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.031532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 273/547] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:26.032728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.044971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.045937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.046497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.046970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.047899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:26.048482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.050097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.067100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 275/548] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:26.068336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.147149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.171102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.182266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef8f6-b5d1-49e3-b947-f4bde850af50 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.189631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4896f-24a8-4c54-9eb1-e84e418b0b37 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.219329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.219935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.220214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.220486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.221277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=5a419e6d58c24957a62b648015ffaac9) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:26.221584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.223123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.228794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.229455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 274/549] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/role_assignments?user.id=5a419e6d58c24957a62b648015ffaac9&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:26.230005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.230458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.230917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.231414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.244600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:26.250738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:26.252175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:26.253149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:26.255959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 276/550] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:26.263569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.348348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9873d8-ed8e-4d37-9d12-4db48b278120 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.375769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ab2d7-0b59-46c8-af91-d5efd02530c7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.391425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.391425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.391425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.391425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.397240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.398868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-41821a60-ddd6-4d44-bcf3-8e2b7ba141b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:26.413183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:26.414196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:26.415254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:26.418240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 275/551] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:26.424426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e68c0-110b-458a-902e-0b460359b7a1 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.424979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e68c0-110b-458a-902e-0b460359b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.425423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.426576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e68c0-110b-458a-902e-0b460359b7a1 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.428829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 276/552] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:26 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:26.430131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e68c0-110b-458a-902e-0b460359b7a1 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.434285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.435027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.436283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.436283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.436633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:26.437004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.438508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021806e4-2e76-40d6-85c0-6bc995b5c36c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.449953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 277/553] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:26.455111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.455111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.455111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.460545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.476729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:26.477888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:26.562350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 278/554] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:26.563516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.564680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e68c0-110b-458a-902e-0b460359b7a1 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.603008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.605459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.605918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.606422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.607422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:26.607937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.609567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.634011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 277/555] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:26.635345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.681845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a7c11-0255-4966-9585-b6c186eb0c76 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.707317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.723745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:26.734155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.735128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.735846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.736204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.750713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.751553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08419521-c34b-4b25-83d9-f7f331d92c0f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.752376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:26.772575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:26.773509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:26.774355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:26.774355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:26.774355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:26.774355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:26.779175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 279/556] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:26.780326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.796332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.797044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.797663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.797939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.811168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:26.817394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:26.818819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 278/557] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:26.820170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:26.915672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3908f-09dd-4380-8021-cafe5688dd99 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.949565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91810e2-2b2d-4b30-a274-d96f6b85c904 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:26.954285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.955171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.955670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.956141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.992168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:26.992997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:26.993279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:26.993548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:26.994248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:26.994603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:26.996116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:26.997774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.015286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 279/558] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:27.015286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.016902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.050781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.052358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.144928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4013dea-1284-4d74-b3a4-9dfebc7e577e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.171907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 280/559] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:27.171907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.190993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.191660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.191936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.192206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.193098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:27.193403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.194774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.203879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 280/560] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:27.204699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.262219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.262800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.303289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203903-bc5d-4f97-8fca-54ddfdb235e0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.313071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4df973-a556-42a2-8677-2cece329fcd6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.348629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.349127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.349439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.349790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.350134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.350553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.351004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.351489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.359182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.361264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.364605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.366388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:27.376167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:27.377160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:27.378144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 281/561] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:27.378815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:27.385297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:27.386274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:27.387180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:27.387180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:27.387180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.387180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:27.389380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 281/562] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:27.390435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.502403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e15b1-a10d-4315-ab97-cea26b75b473 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.506291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350186-ada1-48be-92d6-ae348d30c527 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.517319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.531668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.540559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.541382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.541669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.541998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.545370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.546017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.546280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.546556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.547376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:27.547711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.549158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.552983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.554437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.573102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 282/563] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-ba53d719-2e01-4e20-89ac-32858052b178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:27.573321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:27.574324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:27.575203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:27.575203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:27.575203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.575203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:27.575450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.575541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 282/564] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:27.576294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82723e-7e79-4f44-af64-cdd3f1ba0ea6 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.576591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82723e-7e79-4f44-af64-cdd3f1ba0ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.576876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82723e-7e79-4f44-af64-cdd3f1ba0ea6 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.578150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 283/565] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:27.578843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82723e-7e79-4f44-af64-cdd3f1ba0ea6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.685773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96480d2-cf90-4453-9090-6d31af4ca307 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.687295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82723e-7e79-4f44-af64-cdd3f1ba0ea6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.720955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.721140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.721581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.721681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.721862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.721958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.722137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.722242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.722880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:27.723138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.724556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.733554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.735000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.741209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 283/566] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:27.741209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-39439c02-1933-4587-b6da-4616d86c7bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:27.756480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:27.757362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:27.758311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:27.758311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:27.758311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:27.758311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:27.758311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 284/567] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:27.759025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.759215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.759527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.774508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.778106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:27.779320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:27.807290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:27.851419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 285/568] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:27.851770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.865529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508792eb-3cd5-4a6f-b26a-328351ac7790 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:27.912985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:27.913614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:27.913897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:27.914174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:27.914876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:27.915181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:27.916596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:27.934574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 284/569] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:27.934574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:27.965289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3161d6-c734-4a25-8c34-d9f03e43efe5 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.003102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.003942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.004271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.004661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.012165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.013822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:28.026176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:28.027458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:28.028418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 286/570] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:28.028909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.031770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.048428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c91a5e-8413-4f26-80dd-cdc3d169fa4a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.057934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.086731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.087489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.087775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.088047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.088755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.089092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.090613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.103253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 285/571] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.104079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.140610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d840-eab6-4f4d-acf0-bbe561512bce None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.178414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.179124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.179439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.179758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.190772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:28.195865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:28.196777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:28.197623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 287/572] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:28.199161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.219078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef407e16-8d07-49a0-9af6-83f98c499132 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.256025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.256773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.257545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.257833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.266517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.268483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:28.281270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:28.282317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:28.283251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:28.283805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 286/573] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:28.284375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.295670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.296576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.318865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73c9-c1e9-47e5-b849-ac5963473c53 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.355379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.356315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.356602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.356879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.357640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.357948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.359415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.371280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 288/574] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.372134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.402978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec609e02-8d2d-4ac3-8d83-3efd22200882 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.436886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.437532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.437816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.438093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.445396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.446860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:28.458380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:28.459468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:28.460544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:28.463497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 287/575] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:28.464540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.473443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915a329-e0dd-4ee3-97e1-de03f7fbc6eb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.507724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.508368 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.508655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.508934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.510595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.510595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.511388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.519633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 289/576] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.520363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.529840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.531343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.566531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4b2a-856e-4fdf-8386-100eee315c88 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.601132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.602301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.602586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.603436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.603752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.605300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b93728-f8b4-452e-9069-6fbaa3e51870 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.623936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 288/577] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.625260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362434-6cd2-48f6-9a16-e60e6e45b4b8 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.625555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362434-6cd2-48f6-9a16-e60e6e45b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.625836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362434-6cd2-48f6-9a16-e60e6e45b4b8 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.626075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb38183-a3bc-4640-a654-fc020ab5278d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.627213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 289/578] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:28.627876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36362434-6cd2-48f6-9a16-e60e6e45b4b8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.665537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.666160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.666445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.667661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.667661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c5f9d739145b45f4a689648350d9ecda) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.668124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.669443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.674846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 290/579] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/role_assignments?user.id=c5f9d739145b45f4a689648350d9ecda&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.675754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.743192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36362434-6cd2-48f6-9a16-e60e6e45b4b8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.754289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.770751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:28.782739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.783411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.783702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.783980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.784757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:28.785075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.786911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.799049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b799a-5b4e-424b-99cb-6632ceb7469c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.801549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 290/580] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:28.802569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.843971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.844633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.844916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.845192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.856785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.858260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-73c4bc6f-94a6-4f43-a72b-984223c36ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:28.874439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:28.875526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:28.876423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:28.876423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:28.876423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:28.876423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:28.876423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 291/581] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:28.877426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.877426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.877426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.896345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:28.897557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:28.932590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06218e7-f0d9-4ffe-b20e-3a6db5badc10 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:28.969651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:28.970316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:28.970821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:28.970930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:28.983411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 292/582] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:28.983411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:28.994842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:28.996831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:29.012757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:29.013885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:29.014973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:29.014973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:29.014973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:29.014973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:29.018536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 291/583] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:29.019403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.042776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.058096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.095944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cb50e-983f-4269-a8e2-7508eb71cfca None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.128165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8ed2-1026-4c68-b239-02a8d0c63c94 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.133913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.134598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.134877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.135156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/f1522c66319745588bc60119696076db/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.150524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=f1522c66319745588bc60119696076db, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.152566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.164746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.165381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.165666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.165946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.166654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:29.167001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.168417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 293/584] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:28 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/f1522c66319745588bc60119696076db/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:29.168526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.169497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.193746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 292/585] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:29.194981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.303963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.311705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7475-e742-43ee-9636-bdf07b733855 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.325819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fe27f-718e-4f8c-a694-ed7bcf525fc4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.328050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.349693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.350469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.350836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.351198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.352079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:29.352493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.354092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.366934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 293/586] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:29.367979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.368807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.369534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.369888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.370316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.381654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:29.386772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:29.387987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:29.389004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:29.390505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 294/587] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:29.391393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.490138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e16d0-b5c3-4076-88fb-9daf6b73d3ff None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.512885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3235-9ec3-4f1e-a6b7-e101f974eb00 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.525839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.526658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.527037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.527530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.535989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.537576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.549772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:29.550341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:29.551503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:29.552637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:29.553682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.554189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.554313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 294/588] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:29.554972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.559888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.563315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.565114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:29.578140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:29.579188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:29.580426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:29.582156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.582776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 295/589] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:29.584023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.611849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.673867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290442-359a-4d06-84e3-b7f86e3a8583 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.708224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0363727-d63d-47ac-816e-706d7e16ffe5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.710123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.710797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.711896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.711896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.712375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:29.712775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.714340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.727496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 295/590] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:29.728516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.750440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.751377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.751904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.752343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.753772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:29.754499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.756299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.779512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 296/591] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:29.780587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.830563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.858467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d711e-3d5e-4640-9888-b5e31fb30a22 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.896923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195cc9-1bae-4371-bbd8-7615dcde029c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:29.902010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.902899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.903326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.903774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.904764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:29.905215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.907395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.920182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:29.924467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 296/592] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:29.925936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:29.942221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:29.942848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:29.943131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:29.943466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:29.954364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:29.955919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:29.977119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:29.978005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:29.978869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:29.978869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:29.978869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:29.978869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:29.978869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 297/593] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:29.979617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.032320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de53e-0750-4e9b-95d3-b20adfef1c93 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.067127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.068144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.068624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.069091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.079497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.081278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.082169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.082674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1ed58-7d85-4a33-9bf3-306c2c675b43 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:30.098591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:30.099554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:30.100447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:30.100447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:30.100447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:30.100447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:30.102768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 297/594] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:30.103798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.114330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.120796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.121910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.121910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.122190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.138300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=7cc303860598497f85766448bbdd7e4c, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.139868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.159612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 298/595] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:29 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:30.160971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.216388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a27b-8b25-429e-beb0-f9cb5a2a3e3a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.253568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.254556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.255037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.255553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.256572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:30.257124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.258793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.272520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 298/596] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:30.280549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.331882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673aaa-6138-4a66-9093-557d73aaae22 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.366157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.366805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.367087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.367374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.368126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:30.368428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.369846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.375745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.383767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 299/597] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:30.389767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.444732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.448633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa48b-3d1a-48e1-8737-565b53095427 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.485978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.486642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.486925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.487198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.495412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.497138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:30.511838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:30.512832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:30.513757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 299/598] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:30.517230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0151a7-32b2-4ae6-a664-761bd87650ac None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.518783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.553617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.554636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.555133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.555624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.563984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.565701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:30.577813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:30.578723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:30.579649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:30.582113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 300/599] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:30.590998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.676726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded980a-bec6-4d22-8947-1e97c728d135 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.696363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.741384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.742022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.742415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.742691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.743647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:30.743956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.745600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095380-72fa-427c-ae89-bb6871c1a00e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.749216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6042-cc1c-4c5a-bc1a-782c5878c671 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.756734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:30.774656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 300/600] 10.222.0.100 () {56 vars in 1144 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:30.774656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fedaf-4d7b-4bec-b1c3-a472f5668266 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.774656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fedaf-4d7b-4bec-b1c3-a472f5668266 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.774656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fedaf-4d7b-4bec-b1c3-a472f5668266 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.779336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 301/601] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:30.780333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fedaf-4d7b-4bec-b1c3-a472f5668266 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.793222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.794182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.794468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.794741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.795537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:30.795903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:30.797476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c3b27-30ae-4367-913d-97e8df04b72f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:30.815434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 301/602] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:30.815434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.815434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.815434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:30.832662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:30.833790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:30.915316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 302/603] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:30.915316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:30.944194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fedaf-4d7b-4bec-b1c3-a472f5668266 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:30.993139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:30.994040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:30.994327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:30.994604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.010936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.012993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.032219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:31.036319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:31.037568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 302/604] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:31.043253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.055331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4c75a-3d3f-4640-98d6-e9288c1bd590 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.071678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.094997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.095682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.095974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.096253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c2828c36b4144b0098071053b9436388/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.113210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=c2828c36b4144b0098071053b9436388, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.114879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.139447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 303/605] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:30 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c2828c36b4144b0098071053b9436388/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:31.139447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.203382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb124-74f2-49f8-ba18-7b5072a077f9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.263972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fb5c-7fd2-4fdf-ba0f-6b5a00d10230 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.268222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.269137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.269647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.270158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.300414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:31.306461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:31.307446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:31.309030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:31.317848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 303/606] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:31.318035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.318035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.318035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.318035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.319797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.322417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:31.322731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.325710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.359670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 304/607] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:31.371991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.378313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.449890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.482336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af090-ba18-4825-ba2b-83a0e6f09ce9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.524098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.524729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.525008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.525279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.526001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:31.526330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.528506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137670-b759-411c-9c1a-876806eff213 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.540165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2195c2-5f01-466c-9e46-15a1f919313e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.541303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 304/608] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:31.543308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48360e1-9c41-4630-b953-5108e5792b32 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.548181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48360e1-9c41-4630-b953-5108e5792b32 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.548492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48360e1-9c41-4630-b953-5108e5792b32 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.550261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 305/609] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:31 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:31.551100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48360e1-9c41-4630-b953-5108e5792b32 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.587391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.588738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.589526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.590644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.600264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.602581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-56c1085d-d392-42fa-aede-276f58c4fb43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:31.618364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:31.619346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:31.620304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 305/610] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:31.621884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.622217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.622498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.642439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:31.643928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:31.679880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48360e1-9c41-4630-b953-5108e5792b32 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.716493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.725819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.726936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.727465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.727885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.735627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 306/611] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:31.736638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.741445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.744067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.746347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:31.764926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:31.765880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:31.766769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:31.766769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:31.766769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:31.766769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:31.768865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 306/612] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:31.774200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.867268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae2a2-426e-4f0b-b245-46a41fab8fbe None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.899458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8b17-a2a5-41ea-b6b6-847678cec8e5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:31.910576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.911250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.912101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.912392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.913160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:31.913472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.915643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.931449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 307/613] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:31.932578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:31.945990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:31.946884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:31.947703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:31.948171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:31.949465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:31.950258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:31.952022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:31.975406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 307/614] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:31.975406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.010907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.034642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.065854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5085-b408-435e-ae7e-06c349cf202d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.083022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6552e-33d8-4fa7-bc4c-362a166ac82e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.103657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.105024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.105818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.106294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.118156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:32.120913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.121661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.121996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.122278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/5a419e6d58c24957a62b648015ffaac9/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:32.125165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:32.126089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:32.126911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:32.129645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 308/615] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:32.130940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.138210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=5a419e6d58c24957a62b648015ffaac9, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.139710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.161184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 308/616] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:31 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/5a419e6d58c24957a62b648015ffaac9/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:32.161184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.294472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c520e1-2df3-4170-b67b-dd6fc528f4ad None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.310318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.337633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.338309 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.338659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.338980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.341420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b2cf-509f-4051-8c34-ef582544048e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.348978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.351058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.351602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:32.366236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:32.367250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:32.368258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:32.369070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 309/617] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:32.375186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.404930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.405624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.405909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.406189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.406916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:32.407224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.408640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.419281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 309/618] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:32.424697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.490241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c36cd-1cd0-4f66-a068-934170bad6e8 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.527812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.528554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.528931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.529216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.530029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:32.530342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.531711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af12d4-80f9-4b2f-a6b2-c3181f050700 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.531933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a0ee-1b42-48cf-80de-7ee2797d6d26 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.551723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 310/619] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:32.553174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9defa-07ce-43b1-84f7-9a3c482ba2e1 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.553471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9defa-07ce-43b1-84f7-9a3c482ba2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.553751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9defa-07ce-43b1-84f7-9a3c482ba2e1 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.555241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 311/620] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:32.558383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9defa-07ce-43b1-84f7-9a3c482ba2e1 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.568356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.569012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.569294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.569619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.580936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.582567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.596625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-9f43d6d8-b773-4914-8ed2-1c27ccf880e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:32.597605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:32.599906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:32.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:32.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:32.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:32.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:32.602018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 310/621] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:32.606055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.606055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.606055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.626098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:32.627239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:32.642383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.697014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9defa-07ce-43b1-84f7-9a3c482ba2e1 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.703486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 311/622] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:32.704441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.742459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.743127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.743447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.743730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.755769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.757303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:32.774870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:32.777269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 312/623] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:32.779332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.807251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044310f9-6136-4b23-b67c-c8872a3f9e7f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.842582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.843214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.843524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.843801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.844502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:32.844809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:32.846185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:32.858475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 312/624] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:32.859323 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.873942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.875255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:32.897665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc734d-93f7-4be2-9444-624217a0ec50 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:32.936294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:32.937049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:32.937335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:32.937611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:32.949392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:32.955004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:32.967549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 313/625] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:32.980658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:32.982431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be0c4-205d-48ef-8662-17e46a6fcc14 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.001992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.002686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.002968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.003243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.003977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:33.004281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.005654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.018693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 313/626] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:33.019711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.077761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f76f0-a14e-44e3-bec0-12ea8fb518b3 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.090163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.118676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.120046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.120896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.121521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.125123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2a347-5268-4a2b-b409-e3175c8d043a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.130313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.131996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:33.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:33.146296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 20:31:33.147387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:33.149416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 314/627] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:33.150480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.153871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.165547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.166180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.166704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.166704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.167810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:33.168049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.169436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.178240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 314/628] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:33.179185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.263211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb489-c209-4620-9e5b-d1b33241fd19 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.281751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca500-7d0a-4953-a49f-94c6f9536546 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.300203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.301190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.301634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.302060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.310006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.311661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.311795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.318327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.318960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.319240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.319558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.320375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:33.320683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.322117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:33.327712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:33.328761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:33.329838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:33.336258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 315/629] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:33.337285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.341030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 315/630] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:33.341853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.410047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.459191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7d014-db9c-44d9-8ffa-f776e1a50698 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.461545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a68e-fa2c-4765-8be5-e8db1327f0d1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.503713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.504677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.504991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.505302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.505647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.505863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.506008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.506194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.507286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:33.507768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.509347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.518764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.520201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.523130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 316/631] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:33.524140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-79ee5de6-ea1a-4739-bc1f-b455a56dcdca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:33.535726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:33.536862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:33.537949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:33.537949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:33.537949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:33.537949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:33.541640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 316/632] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:33.543021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842b1-32b0-46bf-a912-756e7ffa4ade None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.543323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842b1-32b0-46bf-a912-756e7ffa4ade None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.543628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639842b1-32b0-46bf-a912-756e7ffa4ade None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.545032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 317/633] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:33.546683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639842b1-32b0-46bf-a912-756e7ffa4ade None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.588238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.644159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa942a-aa7a-4aca-9b55-1f0a6e692816 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.654723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639842b1-32b0-46bf-a912-756e7ffa4ade None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.668767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.682773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.683454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.683745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.684012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.690970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.691678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.691991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.692243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c5f9d739145b45f4a689648350d9ecda/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.707865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=c5f9d739145b45f4a689648350d9ecda, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.709600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.722976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 318/634] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:33 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c5f9d739145b45f4a689648350d9ecda/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:33.724217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.777358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.779682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ed888-a0da-4848-abbc-125604b595ac None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.837903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:33.875520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b9cb7-0d7e-462d-8b92-9b78c4aa11a5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:33.911849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 317/635] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:33.913499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.913987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.914456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.922040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:33.922813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:33.923986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:33.924276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:33.924990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:33.925302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:33.926693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:33.934911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:33.936133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:33.941269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 319/636] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:33.942250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:33.984061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.012518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 318/637] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:34.012518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.080548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafcf12-66f9-4bd6-a0bb-8d339a6d9635 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.088807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.111583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0b60-1506-40d1-b8ab-3adf1656bc92 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.119509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.120883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.121330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.121868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.134140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.136079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.148193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.149081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.149469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.149850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:34.153911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:34.154996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:34.156005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:34.156005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:34.156005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:34.156005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:34.157916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 320/638] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:34.158985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.164660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.166345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:34.179585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:34.180688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:34.181821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:34.188239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 319/639] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:34.188239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.252591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.277548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c4896-6bc3-464d-9878-6f44e7c56683 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.297209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfcb5c-861a-48a6-bec5-8641f10f2df5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.315235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.316296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.316840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.317263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.329070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:34.335375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:34.336353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:34.337234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:34.337873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.337873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.337873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.337873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.338168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:34.338244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.340170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.341800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 321/640] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:34.343152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.349119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.359449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 320/641] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:34.362204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.454294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0efd2-6b01-46a8-9556-a90cfa737118 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.470262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eacf3-e83b-49a0-b02c-2348d15611c4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.491961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.492595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.492882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.493164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.493972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:34.494282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.495878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.499251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.505756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.506534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.506810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.507867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.507867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:34.508116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.509476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bc5a-8d47-452b-9abb-ffc3a60e8856 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.516525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 322/642] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:34.517562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.522306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 321/643] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:34.523670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944801a9-d52f-4d1e-9cfd-fd1da62ad889 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.523960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944801a9-d52f-4d1e-9cfd-fd1da62ad889 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.524236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944801a9-d52f-4d1e-9cfd-fd1da62ad889 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.525746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 322/644] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:34.530983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944801a9-d52f-4d1e-9cfd-fd1da62ad889 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.603120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.627457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741e97c-15ee-46db-8f42-3eea8fe567a2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.648270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944801a9-d52f-4d1e-9cfd-fd1da62ad889 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.664214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.664834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.665114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.665387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.672400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.673867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.684920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.685751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:34.686001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:34.687036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 323/645] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:34.688332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.694856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.695326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.743965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.767685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.769181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.790861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a52-9ad9-40ab-9f74-ea794dff8571 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:34.828802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:34.829447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.829748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.829976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:34.830087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.841106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:34.842569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-10d7eb40-229c-4758-a193-20cc150e6748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:34.858732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:34.859694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:34.860595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:34.860595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:34.860595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:34.860595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:34.860595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 324/646] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:34.861571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:34.861571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:34.861571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:34.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 323/647] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:34.880911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:34.881634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:34.881984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:34.954075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 325/648] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:34.954939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.005192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.008972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef4a8-c8f2-442e-828c-5aa149c6c943 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.045040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.045669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.045951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.046232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.046990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.047303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.048785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.060794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 324/649] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.061667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.084896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.088802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f31f44-8451-4577-b7c1-45730f65112a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.128528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.129867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.130340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.130831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.131608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.131924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.133304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.149483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 326/650] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.149483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.171132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b9596-9ca4-4cf9-979d-6107d96f75df None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.205762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.206408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.206699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.206974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.218364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.219888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:35.234499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:35.235458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:35.236357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:35.236357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:35.236357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:35.236357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:35.240460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 325/651] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:35.241316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.250428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.257200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2800f-8480-4cb4-bc74-8f466f57437f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.293246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.293903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.294191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.294473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.305092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:35.310515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:35.311481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:35.312329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 327/652] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:35.313015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.322153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.352553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28b28-a006-4008-9de3-fe5f9456eb90 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.388682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.389232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.389515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.389792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.390593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=f1522c66319745588bc60119696076db) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.390908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.392502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.407896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 326/653] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/role_assignments?user.id=f1522c66319745588bc60119696076db&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.408920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.422079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b4a7-6579-40a6-9d59-82bc3a65ed6c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.460665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.461736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.462287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.462772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.471942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.473927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:35.487466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:35.488808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:31:35.489762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:35.492540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 328/654] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:35.493642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.514592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.530452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71bfb-59cf-4c4b-b43c-d06c957b5e4c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.572124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.572757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.573075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.573772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.576200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.576200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.578535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.581422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.597068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 327/655] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.597723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.617689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209281-bdef-4a73-86f9-33409420abc1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.661755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.663104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.663864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.664321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.665393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.666196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.668271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.678529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 329/656] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.679569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.722880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce805-1654-4c1d-82ed-cc8f8e79e6fe None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.760045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.760850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.761133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.761409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.762413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:35.762737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.764903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.787000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 328/657] 10.222.0.100 () {56 vars in 1142 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:35.787195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.788202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.814270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1418e-656a-4eca-bc8a-1903b5fb24ca None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.856938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.857600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.857877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.857975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:35.858151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.865672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.867123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:35.878818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:35.879827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:35.880707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 330/658] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:35.881817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.914034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fdba-e850-45cf-b6bc-89c91c99fc4d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:35.952438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:35.953087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.953367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.953638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.967959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:35.969772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-71f41b5e-eef1-4e47-b016-516d38e2a95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:35.985289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:35.986204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:35.987112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:35.987112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:35.987112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:35.987112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:35.987112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 329/659] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:35.988020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15fc0-851d-4190-bc05-be046388543a None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:35.988529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15fc0-851d-4190-bc05-be046388543a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:35.989012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed15fc0-851d-4190-bc05-be046388543a None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:35.990544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 330/660] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:35.995657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15fc0-851d-4190-bc05-be046388543a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:35.998542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749d5c6-f48d-48b2-a363-fa7046b40c84 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.036324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.037198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.037626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.038070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.048098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.104560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed15fc0-851d-4190-bc05-be046388543a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.109976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.111613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef6a21-311d-4442-bd5a-703ea18cf77c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.112536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.141424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.142049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.142340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.142646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.143429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:36.143766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.145325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.158747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 331/661] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:36.159580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.223598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 331/662] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:36.224407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.224993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.224993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.244552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:36.245812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:36.276912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.279446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ef7f6-58da-49b7-834b-18ce63e2551f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.317077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.317763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.318047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.318324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.319083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:36.319418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.323396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 332/663] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:36.323538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.323615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.338944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 332/664] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:36.340151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.367928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.438375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09952-fec4-4e9d-9426-34f54e9fd1ff None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.444279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5ed72-2c65-4b22-bd19-1391bba32fe0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.477429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.477988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.478272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.478548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.479423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:36.479906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.480945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.481483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.481641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.481888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.482166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.495725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 333/665] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:36.495725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.501390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.503179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:36.520746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:36.521905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:36.523002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:36.523002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:36.523002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:36.523002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:36.528829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 333/666] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:36.529929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.531792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.612863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff9ae-289a-4102-8f55-ba135839fbd7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.625078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.651168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.652003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.652479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.652766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.655697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f3df-ef2e-4a9a-a80a-51a53578903c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.662052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.663570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:36.679304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:36.680344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 20:31:36.681289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:36.685581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 334/667] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:36.687385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.707988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.708913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.709193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.709462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.724747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:36.730585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:36.731714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 334/668] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:36.732549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.807611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.824798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e14c-550f-4483-94f6-3c0e81c50faf None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.850365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc3ee-37aa-4567-b514-61e28fdfd7e1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:36.865730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.866380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.866658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.866925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.867659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:36.867970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.869357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.886713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 335/669] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:36.887747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:36.894417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:36.895331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:36.895961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:36.896884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:36.897877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:36.898724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:36.900866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:36.911764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:36.926351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 335/670] 10.222.0.100 () {56 vars in 1144 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:36.927477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.006940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280332-21f0-4d6d-a522-c6ef622d29f6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.042749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.043646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.044030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.044600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.045223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:37.045627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.047314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.055076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120cfc5-abd1-4da6-8b91-4555bb74e635 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.056309 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 336/671] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:37.057362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.074930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.098025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.098957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.099412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.099821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.108633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.110921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:37.125919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:37.127014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:37.128180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:37.130758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 336/672] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:37.131733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.183621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7677-4b7e-4011-b559-ac7b2958fcf4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.191309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.233233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.234281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.234663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.235037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.239219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea785c6d-250d-4e5d-af59-47a2a51c1791 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.274386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.275275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.275712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.276120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.287796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.289879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:37.305402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:37.306496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:37.307743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:37.307743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:37.307743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:37.307743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:37.309886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 337/673] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:37.310869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.329512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.331444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.352429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.422142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674550a8-cfb0-4126-b340-3460e6cee073 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.432502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.460242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.461236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.461725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.462312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.463404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:37.464008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.465818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.471428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 337/674] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:37.472256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.590305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f73986-d6ff-4d44-9da5-c41f9d17f386 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.610910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 338/675] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:37.613556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.617207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.639778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.640401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.640679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.641031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.641854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:37.642027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.643780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.655877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 338/676] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:37.656725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.740757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13211e2-3b14-47ee-ab17-eb288dafe5e0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.769032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787d38-2ea6-4078-baca-9d759ddf501b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.775675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.776391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.777325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.777606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.788397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.789906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-edd8c0a2-ddd9-4ab4-b0d3-1b4193fdd666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:37.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:37.807667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:37.809210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:37.809210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:37.809210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:37.809210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:37.809210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 339/677] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:37.809645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58b88-947b-4cd0-86b4-8d3f6f7cf6a5 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.809929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58b88-947b-4cd0-86b4-8d3f6f7cf6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.810203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58b88-947b-4cd0-86b4-8d3f6f7cf6a5 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.811610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 340/678] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:37.814576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:37.815217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:37.815778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:37.816055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:37.816161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58b88-947b-4cd0-86b4-8d3f6f7cf6a5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.816858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c2828c36b4144b0098071053b9436388) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:37.817175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:37.818598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:37.836514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 339/679] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/role_assignments?user.id=c2828c36b4144b0098071053b9436388&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:37.836514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:37.857536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.894042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:37.960751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58b88-947b-4cd0-86b4-8d3f6f7cf6a5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:37.981939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c4a5-a364-4942-a14e-3a9c96116bb2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.003045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.004923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.005399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.005841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.017380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.017719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.026348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.027121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.027407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.027699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.028537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:38.028842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.030263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-3e52e1f3-4c13-4d8a-8c2e-4cc68f146d55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:38.032182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:38.033103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:38.034043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 341/680] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:38.035089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.035587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.038968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.043672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 340/681] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:38.044835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.062377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:38.063946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:38.161247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.163178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 342/682] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:38.164372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.174950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418751-e3d5-44aa-a949-6a8350c22390 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.178065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.229260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.230203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.230586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.230989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.232027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:38.232438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.234109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.258483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 341/683] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:38.259707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.290260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24ec65-2aac-486f-8e74-38a08fd7831a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.328759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.329811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.329811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.330111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.337604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.339105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:38.352281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:38.353232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:38.354802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 343/684] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:38.355290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.392548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9dd-1ff8-4de8-ad80-3e0c39894029 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.429385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.439969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.441342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.442252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.442891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.457040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.459674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.470254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd6ce-9915-4da4-ac17-9cc01409b6b8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:38.480952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:38.481958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:38.482887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:38.482887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:38.482887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:38.482887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:38.485401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 342/685] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:38.486333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.502223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.518605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.519476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.519966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.520339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.596018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.597339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36618bf8-030e-4a11-bf72-1b6239c441e5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.629922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c44ff-22cd-4b8a-8471-8de2e9fc8995 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.671230 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.679201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.680646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.681078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.681491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.683069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:38.683572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.685814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.701038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 343/686] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:38.701989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.708053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 344/687] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:38.711391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0842-0caf-42b4-830d-423b944fc657 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.711391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0842-0caf-42b4-830d-423b944fc657 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.711391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0842-0caf-42b4-830d-423b944fc657 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.711391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 345/688] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:38.712224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0842-0caf-42b4-830d-423b944fc657 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.776764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.811116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336cd2-7826-4523-a2da-2ea0dcc61f31 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.823851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0842-0caf-42b4-830d-423b944fc657 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:38.847918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.848542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.848832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.849124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.849812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:38.850124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.851638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.859112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:38.859762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.860034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.860588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.861087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=5a419e6d58c24957a62b648015ffaac9) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:38.861399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:38.862814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ced32-592f-43d0-9809-25aa42a73f66 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:38.867884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 344/689] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:38.867884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:38.873523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 346/690] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/role_assignments?user.id=5a419e6d58c24957a62b648015ffaac9&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:38.881700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:38.881700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:38.881700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:38.897920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:38.899138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:38.931577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:38.985944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 347/691] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:38.987185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.012354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98e9f-a733-4936-82eb-fd095a5a6c19 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.049527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.060013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.061055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.061655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.062132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.075321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.077430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:39.097305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:39.098289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:39.099189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:39.099189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:39.099189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:39.099189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:39.100869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 345/692] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:39.105685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.131760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097b2cd-95a8-4e4b-87b4-4c458d3ac05e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.173481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.174123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.174408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.174728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.175475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.177046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.199820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 348/693] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:31:38 2022] POST /identity/v3/users => generated 255 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:39.200555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.224958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3488-896c-48a2-9ff6-7fc3e9dbe8cb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.264505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.270994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.272608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.273032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.273542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.287827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:39.294717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:39.296428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:39.297457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:39.300397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 346/694] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:39.312681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.415801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.418033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7249b5-7395-4fb9-8630-5abe4d0eb6f4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.462591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.463480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.464231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.464665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.465504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:39.465943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.467488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.480549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2811-ae09-40b1-b33d-f3045b054575 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.481037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 349/695] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:39.486145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.516430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.517067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.517354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.517633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.518419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:39.518730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.520165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.536722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 347/696] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:39.542477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.578897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.600314 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0dd47-5384-4666-8649-49e1994a332b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.638265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.639251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.639717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.640128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.647919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.649661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.653397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0b0f-f495-4ae7-907f-022f4c1c02bb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.655129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:39.664424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:39.665502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:39.666478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:39.669362 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 350/697] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:39.674760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.693267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.693924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.694212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.694490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.706690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.708343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:39.724585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:39.725672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:39.726689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:39.726689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:39.726689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:39.726689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:39.726689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 348/698] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:39.731642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.812233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd4aa-3ba2-4030-adf1-b14d01a1a855 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.855789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649e94-e7fd-4183-b488-0875c1ac7039 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:39.859669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.860468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.860886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.861290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.862198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:39.862654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.864741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.876227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:39.880802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 351/699] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:39.886502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:39.944103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:39.944763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:39.945055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:39.945340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:39.946059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:39.946369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:39.947802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:39.981854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 349/700] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:39.988424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.002511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d797b-08b6-4caf-9e21-9c37e6399999 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.030536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.043660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.044800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.045218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.045754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.047282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c5f9d739145b45f4a689648350d9ecda) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:40.047762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.049787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b245bd-60a0-4174-899c-ed6febfe6633 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.058870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 352/701] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/role_assignments?user.id=c5f9d739145b45f4a689648350d9ecda&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:40.060487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9425bab-9903-4b23-8f58-3e453b032422 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.060993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9425bab-9903-4b23-8f58-3e453b032422 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.061432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9425bab-9903-4b23-8f58-3e453b032422 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.063800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 353/702] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:40.071088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.073027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.073687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.112033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:40.113818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:40.135129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de08d3-a92b-485d-bea3-fa5968c8eb7e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.196632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.197168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.197457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.197741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.208368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.214857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.216388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.227732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 354/703] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:40.239927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:40.241017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:40.241936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:40.249068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 350/704] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:40.254533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.284170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.388699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.390394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304aa2c-15bf-4aa3-8ce4-a0b524e75985 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.425951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03c552-09d6-47bd-bfee-d01e7073cef7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.427050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.427723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.428000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.428269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.429068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:40.429367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.430900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.449953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 355/705] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:40.461501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.474582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.475611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.476398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.476828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.477925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.479892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:40.494820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:40.496230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:40.497258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:40.500357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 351/706] 10.222.0.100 () {56 vars in 1134 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:40.506763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.534327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.604390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b731-300d-4b01-8618-f1b7f5df1790 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.650782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.651352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f687cc0-7599-4baa-b611-477df99a0810 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.652112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.652597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.653320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.691113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.691896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.692138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.692440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.693209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:40.693525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.695053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.700760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 352/707] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:40.706212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:40.709287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.744672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.748012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.818543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:40.822032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a60c5-9444-405d-9d6f-c98640cd610d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:40.858841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:40.859711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:40.859997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:40.860343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:40.861104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:40.861476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:40.863024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:40.869248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 353/708] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:40.881161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 356/709] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:40.891518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.014202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:41.066376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8f7ac-478d-48bd-929d-88ea7d4199ec None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.106318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.106972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.107255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.107577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.119321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.121046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b320ab23-aaf2-44d5-8a13-395a7b82be72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:41.137600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:41.138609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:41.139568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:41.139568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:41.139568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:41.139568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:41.139568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 354/710] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:41.144891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.209079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3734-b3c2-45ec-a265-1a39d4274131 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.209408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3734-b3c2-45ec-a265-1a39d4274131 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.209719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3734-b3c2-45ec-a265-1a39d4274131 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.211408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 355/711] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:41.216785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.217076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.217356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.244502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:41.245794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:41.296942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efff2b3-835c-4032-84ea-5b4bee65eaaf None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.362318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.362955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.363235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.363536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.364927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:41.365237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.368849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.378682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 356/712] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:41.389331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 357/713] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:41.395030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.444220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.468013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:41.481441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:41.559728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd150-9f45-4529-8ffe-cfd0e30efd28 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.595315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.596263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.596681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.597089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.604318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.606177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.608104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43136-3c0a-4925-aaae-25d679ab9c59 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:41.617760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:41.618889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:41.620034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:41.622060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 357/714] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:41.627679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.677172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.678094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.678475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.678849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] PATH_INFO: `/v3/services/network` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.679621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.681143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:41.703305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:41.704537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:41.705501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:41.712926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 358/715] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:41.719495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.735608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96658b-8099-4329-b4dd-7e8b4fcad96e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.759721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:41.778896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.779562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.779856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.780322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.781079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:41.781385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.782822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.809528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 358/716] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:41.816105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:41.879744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:41.896940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52f0d-84a1-420e-af32-0b2101d14658 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:41.934109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:41.934965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:41.935320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:41.935692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:41.936459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:41.936837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:41.938493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:41.943506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 359/717] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/services?name=network => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:41.949006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:42.009175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5add4-0c54-4fb9-bb64-7972963f403b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.044527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.045434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.045866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.046290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.047231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:42.047716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:42.049336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd9c4d-4afa-49b3-ba66-f858c5464da0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:42.055539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 359/718] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:42.126894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a427e8-61b4-4bf7-afb8-f401213aba70 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.127558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a427e8-61b4-4bf7-afb8-f401213aba70 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.128057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a427e8-61b4-4bf7-afb8-f401213aba70 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.130134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 360/719] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:42.136129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.136613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.136956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.164837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042c1a0-6830-441a-a0fc-914e7897c5e9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.187584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:42.188810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:42.220152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.220812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.221101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.221383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.222095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] RBAC: Adding query filter params (type=network) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:42.222472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:42.223896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:42.228875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:42.234443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 360/720] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:41 2022] GET /identity/v3/services?type=network => generated 125 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:42.277254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 361/721] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 20:31:42.300628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:42.304933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:42.414599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1900f-0bf5-4c35-98ec-636448d32932 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.451743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.453213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.453696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.454179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.465494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:42.471204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:42.472147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:42.472985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:42.479698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 361/722] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:42.481889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:42.584342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa180c-daee-464e-a643-3c619211b0b4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.619770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.620856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.621351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.621827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.622748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:42.623255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:42.624865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:42.633957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 362/723] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:42.639983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:42.705102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:42.745008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443eafc-6719-4add-a5a9-99b71d435071 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.781298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.781956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.782243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.782518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.795464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:42.796935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:42.811659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:42.813704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:42.817096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:42.817096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:42.817096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:42.817096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:42.817096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 362/724] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:42.819400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:42.849334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:42.921984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc8de-ebbe-417c-8f36-024bd23d2913 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:42.955966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:42.956500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:42.956785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:42.957868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:42.958583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:42.958897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:42.960308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:42.972951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 363/725] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:42.978477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.083396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581fda-43dd-4cee-a388-73ec919f25df None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:43.100398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:43.118558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:43.119207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.119526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.119825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.127991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:43.129451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-737ec46a-86ed-4b04-9a13-47b9024fbc49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:43.141084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:43.144505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:43.153193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 363/726] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:31:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:43.154488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.244887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:43.256069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738ab60-2807-4b79-b40a-a240f0764c44 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.256478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738ab60-2807-4b79-b40a-a240f0764c44 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.256856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738ab60-2807-4b79-b40a-a240f0764c44 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.258309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 364/727] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:43.258582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd00b-de4a-4782-9e9f-db44b23f20ed None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:43.265680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.265971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.266251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.300388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:43.301683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:43.330482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:43.331344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.331652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.331930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.332746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:43.333064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:43.334508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:43.370680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 364/728] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:31:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:43.374789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.443917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 365/729] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:43.494205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.549259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4659-2f83-43ff-ab2c-9c81622e072e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:43.608434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb3ec2-afb4-45e1-acab-dc69139c0c50 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:43.613784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:43.614431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.614718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.615001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.617056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:43.639794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:43.647843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:43.648959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.649339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.649794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.661374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:43.666960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:43.668923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:43.670726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:43.672128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 366/730] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:43.680171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.751621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:43.753678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b9ce-f82e-432b-8c12-830ef07ab345 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:43.836893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004f45-63d9-4be7-a4a0-2b419f52b05c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:43.873034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:43.873837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.875202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.875202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.875533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:43.875871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:43.877422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9133-8e33-42fb-9177-b9d521c60b73 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:43.886590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 367/731] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:43.888117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab230-1a95-4581-b38f-7550e5d499e0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:43.888521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab230-1a95-4581-b38f-7550e5d499e0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:43.888904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bab230-1a95-4581-b38f-7550e5d499e0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:43.896309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 368/732] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:43.897635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab230-1a95-4581-b38f-7550e5d499e0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:43.947481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.059471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 365/733] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:44.061100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.061527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.061930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.069546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bab230-1a95-4581-b38f-7550e5d499e0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.081502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:44.083165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:44.105884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.106605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.106956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.107926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.120450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.122011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.125444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:44.140310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:44.141324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:44.142217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:44.142217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:44.142217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:44.142217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:44.144653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 369/734] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:44.145825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.166880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 366/735] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:44.168198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.234391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.252697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380bc4d-918a-4068-be78-6e55c7f65c81 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.287802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92ec7-7928-4c08-a0f6-505985f48093 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.290158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.291058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.291546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.292426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.303791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.305615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:44.321948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:44.322965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:44.324042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:44.324042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:44.324042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:44.324042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:44.325624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.326320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.330997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.330997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.330997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:44.330997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.330997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.331546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 370/736] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:44.332658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.342597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 367/737] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:44.343467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.375453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.447793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa34618-efae-4be0-8eaf-6dd6332b4b96 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.453717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd881-f775-4268-8018-ec8f49a0937a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.483908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.484708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.485057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.485401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.486199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:44.486568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.488054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.491215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.497956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.499702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.499990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.500266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.500981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.502370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.509516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 368/738] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:44.510891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.529209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 371/739] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:31:44 2022] POST /identity/v3/services => generated 252 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:44.530297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.628067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.640118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd7d3f-1606-482d-bb60-6cba013a8c9b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.697797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.699563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.700132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.700637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.709592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.711461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-27be830b-19fa-4acc-a29f-50081615b8a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:44.725667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:44.726714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:44.728103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:44.729060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 369/740] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:44.731260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6af75f-5b7d-4356-9a5f-74c536354f44 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.731843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6af75f-5b7d-4356-9a5f-74c536354f44 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.732868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6af75f-5b7d-4356-9a5f-74c536354f44 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.734459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 370/741] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:44.735096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6af75f-5b7d-4356-9a5f-74c536354f44 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.784568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cad84d-cfcf-41f2-b54b-c6b65d97c7e3 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.830691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.831630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.831765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.832097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.840215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.841719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-34a0f648-5995-462f-9a23-6f5184466d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:44.853398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:44.854401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:44.855627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 372/742] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:44.856256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.856546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.856827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.880173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6af75f-5b7d-4356-9a5f-74c536354f44 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:44.884347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:44.885677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:44.928659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:44.929620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:44.930070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:44.930756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:44.932834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:44.933474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:44.935164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:44.952202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.970083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 371/743] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:44.971594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:44.983076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:44.992839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 373/744] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:44 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:44.994404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.094055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a7d0-adac-44bd-a3ac-9a985c48c213 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.114605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0250d-3612-4f06-aab8-ac480e0cfa57 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.132840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.133398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.133681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.133961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.134728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:45.135071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.136584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.152271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 372/745] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:45.152454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.152454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.152640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.152711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.152711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.204043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.221292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.226497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.228129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.256675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802913d0-62fe-47b7-b9b8-8695fffbef9a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.290816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.291500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.291842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.292258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.303815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e50d52fd-b912-4a0f-9141-d885222d27af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:45.309792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:45.310915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:45.311931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 373/746] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:45.312758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c42a-5737-4764-b2ec-1cdf629a2dae None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.312758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c42a-5737-4764-b2ec-1cdf629a2dae None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.313001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069c42a-5737-4764-b2ec-1cdf629a2dae None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.314236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 374/747] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:45 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:45.314923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069c42a-5737-4764-b2ec-1cdf629a2dae None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.349913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 374/748] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:44 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 20:31:45.352873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.431005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069c42a-5737-4764-b2ec-1cdf629a2dae None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.444553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.458984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.465243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914c41-7ecd-4064-b476-015c5cc366a5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.468495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.469122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.469404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.469681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.470477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7fb919f2578a4e57b25f27b97822e0d1) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:45.470789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.472273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bc14-7c3e-4b36-9687-cdc417f12e5c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.478151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 375/749] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/role_assignments?user.id=7fb919f2578a4e57b25f27b97822e0d1&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:45.479671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.480172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.480685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.500289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:45.501980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:45.516798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.517581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.517768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.518008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.518746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:45.519059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.521240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.533435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 375/750] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:45.534777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.599750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 376/751] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:45 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 20:31:45.600726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.657404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117954c-75bf-4fe0-98f5-a2cd4203a0b4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.693779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.694759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.695232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.695736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.707617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.709380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.711308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1557-f36b-4e5f-8608-b2f29a6f9692 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.713039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:45.729307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:45.730290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:45.731196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:45.731196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:45.731196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:45.731196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:45.731808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 376/752] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:45.732398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.733274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:45.752402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.753063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.753346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.753623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.765589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.767068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:45.784043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:45.784981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:45.786211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:45.786211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:45.786211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:45.786211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:45.786429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 377/753] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:45.790752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.853316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d5143-73ed-4ec5-aa89-c8caf61ba233 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:45.889105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:45.889732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:45.890019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:45.890296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:45.890990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:45.892413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:45.912945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 377/754] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:31:45 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:45.914197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:45.921029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b30b-fff6-456c-9b78-0237ecf8d819 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.008092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.008749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.009037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.009340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.010058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:46.010419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.016066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.048286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 378/755] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:46.049827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.052714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:46.100329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:46.121570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc204721-d57d-48f6-8628-27986625d169 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.165615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.166265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.167782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.168014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.169077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:46.169388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.171495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.180024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa9824-ed0e-42ce-a285-ef52167056e4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.187465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 378/756] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:46.193866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.223243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.223901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.224192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.224472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.232622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.234352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:46.247716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:46.249352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:46.250477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 379/757] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:46.255524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.330753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25c78-bdf3-4550-b8c7-956927eb0179 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.368528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:46.415282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.416046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.416331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.416807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.419819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:46.427034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.428639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.439572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61330d22-4720-4727-9eaa-eb57a41cedb0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:46.446531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:46.449303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:46.451338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 379/758] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:46.458454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.511823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.512387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.512672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.512951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.514078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:46.514445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.516145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.531394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 380/759] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:46.538116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.668096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd500-fb5b-4b50-9cb9-4119f39d6bcb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.706348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551540a-371f-4ad6-8dfd-f8534e560acd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:46.738209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.739704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.740190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.740689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.741749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c5f9d739145b45f4a689648350d9ecda) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:46.742340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.744175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.755298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 381/760] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/role_assignments?user.id=c5f9d739145b45f4a689648350d9ecda&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:46.766649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:46.767739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.768249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.768769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.769852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:46.770373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:46.772125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49aa3b-1128-47ec-8672-4e863aa22252 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:46.802654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 380/761] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:46.808138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:46.841779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:46.864176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0aa2-fca8-4920-b6dc-515a53fc2691 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.864873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0aa2-fca8-4920-b6dc-515a53fc2691 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.865347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0aa2-fca8-4920-b6dc-515a53fc2691 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.868443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 381/762] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:46.873546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:46.874158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:46.874624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:46.898835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:46.901572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:46.966546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.028863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d763-90bc-4f48-a371-23ba8248aab4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.054046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 382/763] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:46 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:31:47.071425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.072077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.072358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.072634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.083616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.085070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.100004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:47.104503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:47.105489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:47.106399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:47.106399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:47.106399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:47.106399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:47.107091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 382/764] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:47.119224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.202862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.250803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219aebf-6991-4f2c-9594-e1173247db09 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.274581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525021-1ae0-4569-8bef-5ef39b64a416 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.286058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.286642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.286926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.287202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.287887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.289282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:47.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:47.299626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:47.300688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 383/765] 10.222.0.100 () {56 vars in 1134 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:47.311776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.336666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.337316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.337663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.338025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.338951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:47.339486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.340993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.344485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.362007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 383/766] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:47.368323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.419861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f48e-a65f-42a7-9c3b-76b3905ef3de None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.498118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.499139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.499637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.500127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.501154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:47.501977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.503859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.515483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 384/767] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:47.521083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.553349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a34312-81bb-40f2-a551-ec11403f71b7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.578444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.591482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.592511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.593003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.593490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.611196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.613365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:47.630132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:47.631070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:47.632050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:47.640816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 384/768] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:47.645168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.700572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.715992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15d31a-99e5-4cb0-a839-2f7f608f1483 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.765796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.768039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.769764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.770279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.771221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:47.772945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.776681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.786415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 385/769] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:47.792688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.845278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52147b-9dbc-478a-ae19-2a823f91a081 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.881982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.882996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.883517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.884012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.884956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:47.885490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.887546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f373a0-bf6b-4efc-97c9-a3553dd7440b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:47.901979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 385/770] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:47.903660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00c00-a343-4642-a759-05b5db8d735a None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.904180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00c00-a343-4642-a759-05b5db8d735a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.904649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00c00-a343-4642-a759-05b5db8d735a None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.906410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 386/771] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:47.908104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd00c00-a343-4642-a759-05b5db8d735a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:47.940590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8112ad-db33-43a9-998d-9c609605092f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:47.965304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:47.990618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:47.991262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:47.991576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:47.991855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:47.993278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] RBAC: Adding query filter params (interface=public, service_id=6070d41d854f45b08b672d08d838b3fd, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:47.993600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:47.995344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c96f38-4c01-4072-bb13-0705f0458b35 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.007537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 386/772] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:31:47 2022] GET /identity/v3/endpoints?service_id=6070d41d854f45b08b672d08d838b3fd&interface=public®ion_id=RegionOne => generated 195 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:48.009208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.009778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.011468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.037650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:48.038883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:48.041193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd00c00-a343-4642-a759-05b5db8d735a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.055964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:48.089190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.089985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.090316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.090597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.092812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=7cc303860598497f85766448bbdd7e4c, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:48.094307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.112645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 387/773] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:47 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:48.112645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.139512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 387/774] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:48 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:48.181762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.227233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12b47-21a5-42b6-a2a7-49ff8cd2f0e6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.230357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:48.269196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.269881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.270168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.270457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.271154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:48.272741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8357-ea15-4535-8ab3-ccd847a698a6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.283336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 388/775] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/services => generated 776 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:48.383868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89972-c331-4e82-a887-d09ee0941a5e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.433575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.434681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.435165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.435676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.446360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0b3b-9e4e-4144-afcf-662c44fc15f1 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.446694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0b3b-9e4e-4144-afcf-662c44fc15f1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.446923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0b3b-9e4e-4144-afcf-662c44fc15f1 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.449069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:48.452840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 389/776] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:48 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:48.454186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:48.455091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:48.455984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:48.459394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 388/777] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:48.461419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.462136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.462650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.463122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.477363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:48.488932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:48.490640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:48.596528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f31ed-4143-4897-9216-ae5bcd6a504b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.631383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 390/778] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:48 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:48.656913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.658584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.659242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.660122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.660692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.662289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:48.663085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:48.665916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.694320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 389/779] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:48.696930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.798907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:48.855468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08bfd-012d-4ae0-9e94-59dc8495f1fa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.875106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:48.880957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1368-9458-472b-80c0-be0eb1b11bf8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:48.902160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.903122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.903593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.904033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.915593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:48.917630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.926882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:48.927619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:48.927921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:48.928187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] PATH_INFO: `/v3/services/network` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:48.928896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:48.930494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:48.934647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:48.935545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:48.936417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:48.936417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:48.936417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:48.936417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:48.938647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 390/780] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:48.943180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:48.944172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:48.944993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 391/781] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:48.947309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:48.969618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.089565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294273f-e8ee-405d-9c4c-bbe2e2cbb5f7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.116717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.128878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.130041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.130541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.131033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.131957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.132467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.134067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeec29-4caf-4064-9020-f13f0524fae9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.135490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d7a9-34a4-4cf1-a4db-b675249d663c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.147198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 391/782] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.153113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5b7c-ac46-46e7-be4a-76960b4f0dc0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.153610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5b7c-ac46-46e7-be4a-76960b4f0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.154147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5b7c-ac46-46e7-be4a-76960b4f0dc0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.155877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 392/783] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:49.156812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5b7c-ac46-46e7-be4a-76960b4f0dc0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.171784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.172325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.172654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.172930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.173668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] RBAC: Adding query filter params (name=network) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.174019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.175816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66987061-0f44-4ecc-a96c-a85ce98a98ec None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.185581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 392/784] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:48 2022] GET /identity/v3/services?name=network => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.185581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.185581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.185581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.203970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:49.205200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:49.228103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.275726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5b7c-ac46-46e7-be4a-76960b4f0dc0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.278317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 393/785] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:49 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:49.279522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.313336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.314335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.314806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.315383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.323393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.325290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:49.340426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:49.341399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:49.342348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:49.345072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 393/786] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:49.351383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.389293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a918856-28ca-49f5-8ed7-1393a1d17624 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.400128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.435369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.435926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.436206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.436483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.437538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.437538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.438926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.449556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 394/787] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/services?type=network => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.449556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.471279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843084-7b5b-4dfa-804d-cdf25bf73cb1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.476314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.512785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.513561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.513841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.514113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.526754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:49.533664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:49.534590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:49.535783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 394/788] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:49.536542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.574705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44bf1d-9433-454a-ba49-c57e5ddf68a0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.614055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.614686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.614961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.615331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.616455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.616767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.618198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.645916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 395/789] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.646951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.650762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f768-5776-4a14-aa67-01d7cb997134 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.653703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.688723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.689269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.689562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.689837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.690634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] RBAC: Adding query filter params (interface=public, service_id=0c8afc4af0964bde98cad6be6e6cd451, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.690934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.692348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.698962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 395/790] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/endpoints?service_id=0c8afc4af0964bde98cad6be6e6cd451&interface=public®ion_id=RegionOne => generated 195 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.699926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.737811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.761457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73a22-248b-4147-ba9a-438f44866a43 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.798398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.799144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.799522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.799895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.800977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:49.801357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.802891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.812543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 396/791] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.813416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.818195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfc1e-2c21-4604-9bcb-5334830fcedb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.855019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.856042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.856469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.856885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.868412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.870458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:49.886274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:49.887153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:49.888447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:49.888447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:49.888447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:49.888447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:49.891125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 396/792] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:49.892257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.916654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:49.921250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf12cb-8a0f-4515-a355-85502b70ee3b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:49.957289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:49.963047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:49.963047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:49.963047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:49.963047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:49.963047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:49.966124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 397/793] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/services => generated 776 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:49.967515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:49.971233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.018531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82195-c495-4781-981b-a51e4598a12f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.057718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.059026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.059539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.060038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.072405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.074806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:50.091614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:50.092600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:50.093477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:50.093477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:50.093477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:50.093477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:50.095909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 397/794] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:50.101189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.101514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41200-fe8d-40a5-bcc9-590fe37484b4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.208279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.209931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.210806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.211310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.212024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.212737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:50.213145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.214592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.229105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 398/795] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:50.234642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.244060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964658c-9bb8-4a49-85d8-1abfe1b7ec5b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.283486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.284179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.284463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.284737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.285756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:50.286059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.289042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.304400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 398/796] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:50.310562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.312259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.375126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577d4a0-5113-4b53-bb05-a4e17092c981 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.457060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.458190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.458700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.459264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.473006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb7f-4a9f-4d3a-968a-af71d0db713a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.476496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.477956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:50.501367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:50.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:50.503202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:50.509460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.511817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 399/797] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:50.512783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.517233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.518187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.518653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.519109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.527823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.529656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:50.543334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:50.544400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:50.545356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:50.548017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 399/798] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:50.554682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.679672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ddaf7-fe99-409d-8d58-8bef90f13eb5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.693823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df0a3-03c6-4f1f-87c0-2017015e4070 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.716128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.716708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.716966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.717261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.718051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:50.718358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.718802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.719810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d285710-78be-436d-8575-82166825f9a6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.731055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.732005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.732456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.732913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.733832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:50.734358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.736001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830d671-7a36-4d3d-864a-da9a4c91671b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.738498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 400/799] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:50.739800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdc34-b424-454c-aa8d-462af7010c3f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.740087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdc34-b424-454c-aa8d-462af7010c3f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.740362 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fdc34-b424-454c-aa8d-462af7010c3f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.741724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 401/800] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:50.746992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a259-7217-41c5-8fbf-7bbff776e918 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.747349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a259-7217-41c5-8fbf-7bbff776e918 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.747718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a259-7217-41c5-8fbf-7bbff776e918 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.750982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 402/801] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:50 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:50.750982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2a259-7217-41c5-8fbf-7bbff776e918 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.754879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 400/802] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:50.756265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5107b1-0352-413c-b81f-197663ae5ceb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.756645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5107b1-0352-413c-b81f-197663ae5ceb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.757012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5107b1-0352-413c-b81f-197663ae5ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.774630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0f5107b1-0352-413c-b81f-197663ae5ceb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:50.776092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0f5107b1-0352-413c-b81f-197663ae5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:50.808909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:50.854818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 401/803] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:50 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:50.854818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.854818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.854818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.870731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:50.871979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:50.874378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2a259-7217-41c5-8fbf-7bbff776e918 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:50.914184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:50.914834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:50.915111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:50.915453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:50.925781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:50.927241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:50.943381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:50.944416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:50.945381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:50.945381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:50.945381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:50.945381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:50.945381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 403/804] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:50.945653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:50.950639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 402/805] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:50 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:50.952338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.014890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.061219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc8ab-f36d-40cc-9911-bc8b13bd1066 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.063037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.076739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376516b-5061-408a-97f6-50b3e66526b5 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.100943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.101659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.101946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.102229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7fb919f2578a4e57b25f27b97822e0d1/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.114614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.115511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.115961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.116426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.117240 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.118286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=7fb919f2578a4e57b25f27b97822e0d1, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.118725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.119781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:51.128333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:51.129392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:51.130241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 403/806] 10.222.0.100 () {56 vars in 1134 bytes} [Fri Aug 5 20:31:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:51.131077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.140841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 404/807] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:50 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7fb919f2578a4e57b25f27b97822e0d1/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:51.148346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.261010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135c93a-02ca-447e-bb2b-8704e83878f2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.263526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288ba2-55e6-44de-b20f-e5409f3b91fd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.272622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.302641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.303678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.303913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.304327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.304466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.304637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.304731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.304889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.305343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:51.305658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.307062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.317500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:51.320702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 404/808] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:51.321382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:51.322466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:51.323598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:51.324522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 405/809] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:51.331739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.348413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.440597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b7863-1fd4-4a5e-b290-a1558e711f93 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.441610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecca8e-3ed5-47b0-95d7-1ba32343e087 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.476204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.476834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.477114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.477384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.478101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:51.478401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.479912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.481188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.482137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.482615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.483101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.484012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:51.484518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.486185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.488784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 406/810] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:51.489604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.492248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 405/811] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:51.498180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.533377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.574434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.601871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bf98b-c205-479c-a170-5a8c80acca99 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.610683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a3e-53a8-4f4f-a8a4-355c6aaa58be None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.643478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.644903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.645164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.645438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.651436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.652376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.652857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.653099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.653535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.654627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.665861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:51.667241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:51.668138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:51.669041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:51.670569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.673457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 407/812] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:51.674505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:51.689945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:51.690896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:51.691831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:51.691831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:51.691831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:51.691831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:51.694238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 406/813] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:51.695247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.796364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.799297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0b90-5487-4820-b4ed-79eae140806b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.813407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c9d90-9cb3-4be8-8fb8-0f3a865d3d6a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.837240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.838813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.839399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.840043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.841111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:51.841941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.844069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.846297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:51.850367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:51.850999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:51.851280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:51.851598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:51.852374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 408/814] 10.222.0.100 () {56 vars in 1129 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:51.853040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:51.853352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:51.853700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.855154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:51.874593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 407/815] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:51.874593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:51.986432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42c01-22b4-46e6-aa44-5c0d0323d572 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:51.992489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792f46-59b0-4ea8-a07c-d1e710c2f867 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.024812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.026033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.026501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.027198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.028511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.030527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.036582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.037295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.037770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.038266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.038942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:52.039344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.040926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.055216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.061566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 409/816] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:52.062543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.065488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 408/817] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:31:51 2022] POST /identity/v3/endpoints => generated 348 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:31:52.067612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.147541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.197293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44875-e145-4c40-a633-c56b8853548f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.233965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bbed-c2a4-40ca-94cf-98f6a24135bb None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.254208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.254905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.255181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.255477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c5f9d739145b45f4a689648350d9ecda/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.258957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=c5f9d739145b45f4a689648350d9ecda, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.261627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119ccc1-d0c5-4095-a31a-404bb4b1c79c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.280096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 410/818] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:31:52 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/c5f9d739145b45f4a689648350d9ecda/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:31:52.282283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91c09-e677-4657-bc3c-0a0095bb032b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.282574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91c09-e677-4657-bc3c-0a0095bb032b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.282851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91c09-e677-4657-bc3c-0a0095bb032b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.288889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 411/819] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:52.291285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.291670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.292135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.303878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.304681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.304966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.306601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.325682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.331502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.336408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:52.337638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:52.349310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:52.350401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:31:52.351695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:52.355574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 409/820] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:52.357707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.439250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.460745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 412/821] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:52 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:52.486237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.499838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4e974-1efc-4258-8869-9eaed06fe44f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.539512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.540557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.540985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.541495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.542209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.543344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:52.544029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.545635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.567083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 410/822] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:52.573362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.613208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b5d41-7fcd-4ca6-9e8d-0f2a5d50c77c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.678974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f25e8-0ad0-4a12-bb03-f028ffebe7c0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.688115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.688836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.689116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.689387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] PATH_INFO: `/v3/services/network` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.690086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.691500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.697110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:52.709549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:52.710582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:52.711436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 413/823] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:52.717461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.721153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.722043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.722513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.722990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.795853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.797719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.906723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94127-b366-4628-a391-e3cb63ab6b3d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:52.922646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:52.963770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 411/824] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 20:31:52.968801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:52.969680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:52.970185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:52.970641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:52.971561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] RBAC: Adding query filter params (name=network) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:52.972061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:52.973027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:52.973863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:52.982930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 414/825] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/services?name=network => generated 125 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:52.989007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.002777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.146968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c44c-b17f-415e-a3c4-bf650a450960 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.149451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5db62-006a-4ca5-9481-399ff9bd26dc None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.183680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.184265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.184550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.184829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.197189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.198865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:53.216745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:53.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:53.218576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:53.218576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:53.218576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:53.218576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:53.218576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 412/826] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:53.224394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.240247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.241108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.241566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.242005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.242826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:53.243267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.245182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.251031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 415/827] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:31:52 2022] GET /identity/v3/services?type=network => generated 352 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:53.257924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.303554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.363953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76499bee-43af-4041-a524-5bf227a0b9a0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.394106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.406592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.407617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.408121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.408586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.410766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.412464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83c0f-9a17-4938-9196-a0de9e4baf96 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.440693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 416/828] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:31:53 2022] POST /identity/v3/endpoints => generated 339 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:31:53.442853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf97-7694-4357-a3dc-fc5ae6681188 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.443619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf97-7694-4357-a3dc-fc5ae6681188 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.444103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0bf97-7694-4357-a3dc-fc5ae6681188 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.446743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 417/829] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:53.452861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.453480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.454094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.457593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb746-c929-488e-a766-fa4efcb16339 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.478518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:53.480081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:53.520745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.521738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.522286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.522738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.523872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:53.524483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.526225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.554508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 413/830] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:53.559947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.563803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 418/831] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:53 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:53.588059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.617646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.703126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e316a-209d-48df-8d8d-b3425e7415b0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.706916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824375ae-981b-48ff-a5fe-f4bd7400883f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.733429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.741836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.742909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.743338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.743801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.748630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.749420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.749769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.750115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.757335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:53.758188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.759967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:53.763281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:53.764262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:31:53.765115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:53.767923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 419/832] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:53.774071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:53.775128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:53.776137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:53.777595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 414/833] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:53.783046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.870855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:53.887508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2249-d688-4e41-9c35-1e2c9d858658 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.905111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e813de-7079-413f-88fa-686cc6073513 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:53.925841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.926707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.927151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.927598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.928474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:53.929372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.931176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.941825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 420/834] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:53.945529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:53.946322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:53.946721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:53.947058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:53.947985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:53.948218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:53.949125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:53.950694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:53.965572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 415/835] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:53.971632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.031152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:54.075244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e09b6-04bb-449c-8835-021e9e42c089 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.097188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b8b3-5ca7-4a4f-a94e-4070ea7bc305 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.117525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.118257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.118621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.118958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.133989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.134862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.135879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.136163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.136618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.137103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.138093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:54.138585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.140298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.145262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:54.148283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 416/836] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:54.161824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:54.163285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:54.164384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:54.164384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:54.164384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:54.164384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:54.165599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 421/837] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:54.171893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.282511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c460-038e-4811-8e0c-d4fdf05b4d07 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.290379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:54.326524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.327458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.327881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.328295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.329174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:54.329622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.331161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.345213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 417/838] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:54.351097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.459634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b566dc-3a5f-42e1-a42a-2cc9290610af None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.495396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.496345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.496791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.497227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.505513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.507192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-1e28d878-cb0c-4880-bf0e-c0698b18e58a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:54.519390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:54.520357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:54.521269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:54.523482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 422/839] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:31:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:54.529986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.636622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86bc4-f8ea-467c-a877-a6df0059b78d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.637246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86bc4-f8ea-467c-a877-a6df0059b78d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.637711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86bc4-f8ea-467c-a877-a6df0059b78d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.639642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 423/840] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:54.640812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f06-fb64-4be6-adc9-cbff1fb60006 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.652404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acef19-2bd6-4154-9850-9401854fc851 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.652998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acef19-2bd6-4154-9850-9401854fc851 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.653549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acef19-2bd6-4154-9850-9401854fc851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.673646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-66acef19-2bd6-4154-9850-9401854fc851 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:54.675303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-66acef19-2bd6-4154-9850-9401854fc851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:54.678178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.679505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.679505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.679505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.680185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:54.680497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.681940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.705218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 418/841] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:31:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:54.706303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.742321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:54.758256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:54.771189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 424/842] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:54 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:31:54.791126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6375-d1b2-4dda-9479-3dfc805e355f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.791508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6375-d1b2-4dda-9479-3dfc805e355f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.792391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6375-d1b2-4dda-9479-3dfc805e355f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.798936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 425/843] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:54 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:54.799765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e6375-d1b2-4dda-9479-3dfc805e355f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:54.834766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd9b9-efb1-4308-babf-7bc33fc47f6c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.873564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.874290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.874628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.874908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.905912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e6375-d1b2-4dda-9479-3dfc805e355f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:54.942891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:54.943572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.943857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.944132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.944769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.946134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-721742c9-d2e2-44f4-926a-2913c744204a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:54.956800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:54.957825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:54.958677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 426/844] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:54.959855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:54.959939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:54.960216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:54.969360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:54.971747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:54.981623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:54.983350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:54.999759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.046232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.075419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 427/845] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:54 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:55.075419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.090646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 419/846] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:54 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:31:55.092446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.184806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68290167-3c14-47ce-8415-0d1cdd65a3b1 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.199946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1ac6-bcb8-4792-b847-7e8eacf59f82 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.220074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.220709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.220993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.221269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.221961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:55.222268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.223677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.227135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.232861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 428/847] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:55.232861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.244953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.245702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.245982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.246372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.257479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:55.263142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:55.264284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 420/848] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:55.265120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.292570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.356074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9765-dc34-46d9-90c3-355516d36137 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.380523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd06f-1889-4cf9-b0d6-ae4e259dac99 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.395461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.396119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.396394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.396665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.408747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.411043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.424477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.425360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.425813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.426258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:55.426521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:55.427375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:55.433749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:55.433749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:55.433749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:55.433749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:55.433749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 429/849] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:55.434030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:55.434030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.434165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.434233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.436671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 421/850] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:55.436671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.493260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.550235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3d5d4-86e8-467e-9c4a-37aa8eeb82a8 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.554803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.560412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a355fc-9684-4c36-9ac8-654dc5ab9f1e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.588873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.589517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.589806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.590087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.590809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:55.591118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.592543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.601916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.602549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.602828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.603187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.605116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:55.605433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.605855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 422/851] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:55.607044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.612978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.621184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 430/852] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:55.627026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.732703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201fae-b5f9-48b0-854d-8097d3a04f7f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.743221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.765411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103353cc-7381-43d5-afda-4fa5d6ed060e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.773731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.774799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.774973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.775335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.783376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.784975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:55.798963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:55.800125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:55.801205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:55.807517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 423/853] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:55.808563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.811977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.812805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.813214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.814578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.828738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.830789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:55.850739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:55.851871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:55.852918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:55.852918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:55.852918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:55.852918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:55.854854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 431/854] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:55.860808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:55.879212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:55.936129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84d80-c61e-4e97-9819-7df908341613 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.978504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad11d92-3e75-4b26-abbb-e5833e406af9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:55.984953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:55.985876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:55.986365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:55.987170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:55.988132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:55.988578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:55.990816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.007405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 424/855] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:56.013226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.019900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.020739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.021156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.021562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.022396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:56.022886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.024997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.039706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 432/856] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:31:56.045054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.048861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.126419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e173-f0bd-4564-9c4c-80659d62d202 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.145977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.165435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.166341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.166793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.167074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.167954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7fb919f2578a4e57b25f27b97822e0d1) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:56.168271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.169979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.183390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 425/857] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/role_assignments?user.id=7fb919f2578a4e57b25f27b97822e0d1&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:56.183613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511628b1-6ea4-40be-8c61-014f4474ee99 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.228232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.229077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.229487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.229947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.238861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.240300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e194e894-b493-4834-ac00-6f5d7b8ff64f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:56.254770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:56.255813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:56.256733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 433/858] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:56.262094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.284714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc83a-9ecc-4c9e-b5da-e2497a2e1fca None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.285053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc83a-9ecc-4c9e-b5da-e2497a2e1fca None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.285647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc83a-9ecc-4c9e-b5da-e2497a2e1fca None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.287169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 434/859] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:31:56.292819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.293110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.293387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.312855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:56.314209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:56.379509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.392990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdbccf-e2e2-41be-8302-807051509d76 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.402269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 435/860] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:56 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:56.424368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.433718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.434351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.434636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.434914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.435756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:56.436259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.437572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.456619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 426/861] 10.222.0.100 () {56 vars in 1140 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:56.462330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.501536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.544647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e9d4-cc86-4062-a673-db258348ff91 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.581289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.582046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.582327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.582595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.583232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.584642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.584754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94113f-aea8-48df-b2b9-705308c0090b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:56.594735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:56.595737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:31:56.597066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 436/862] 10.222.0.100 () {56 vars in 1137 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:56.602635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.626306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.626949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.627228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.627537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.648960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.710595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.712398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c86b54-b9aa-4023-a92a-e2a055f5c1fa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.712615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.740063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.748649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.749278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.749557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.749885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.750571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:56.750877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.752322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.761550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 437/863] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:56.763191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.864494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 427/864] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:31:56.870526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:56.878796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9dafc-c5d1-4f9f-803f-3df2d9b3510a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:56.914550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:56.915309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:56.915624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:56.915910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:56.916808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:56.917122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:56.918504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:56.927511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 438/865] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:56.945499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:56.990185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365f6d-b5bb-488a-812c-069f0275f6ec None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.028530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.029441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.029890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.030326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.042902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.044662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:57.061117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:57.062284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:57.063383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:57.063383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:57.063383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:57.063383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:57.065334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 428/866] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:31:57.070971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:57.133311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:57.180808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382991d-5ef5-4241-8fbd-0a2520cc3d0b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.216905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.217836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.218260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.218677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.219558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:57.220003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.221717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.235165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 439/867] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:57.243493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:57.347829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81c9bd-3ebb-4ccc-a065-84b98c0be4f6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.349296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:57.384354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.385008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.385382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.385864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.392907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.394352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-bc651dc7-6682-4523-b799-09a42bd449f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:31:57.406280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:57.407172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:57.408128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 429/868] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:57.413828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:57.531424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670638ec-0436-466c-a2f2-1424cf5e293c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.549769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:57.568251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.568886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.569166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.569439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.570201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:57.570511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.572102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bf8e3-e6a6-4d4e-a3fc-a48d3108751c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.583270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47ab2-1cdf-4418-b7b2-cea82026094d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.583590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47ab2-1cdf-4418-b7b2-cea82026094d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.583873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47ab2-1cdf-4418-b7b2-cea82026094d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.584998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 440/869] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:57.585203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 430/870] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:57.590397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.590685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.590959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.592344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47ab2-1cdf-4418-b7b2-cea82026094d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:57.608842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:57.609936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:57.687635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 441/871] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:57 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:31:57.702834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:57.727618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47ab2-1cdf-4418-b7b2-cea82026094d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.778947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.780208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.780505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.780791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.781875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=c5f9d739145b45f4a689648350d9ecda) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:57.782196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.784804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300a08-7a61-4b06-acf3-aa04f62ac2c7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.795450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 431/872] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:31:57 2022] GET /identity/v3/role_assignments?user.id=c5f9d739145b45f4a689648350d9ecda&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:57.825563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969ae0a-5dca-4b67-9fe3-2aecbfba9f1f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:57.837152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:57.866102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:57.866664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:57.866943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:57.867211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:57.867953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:57.869656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37825054-4124-482d-a2a6-6d28c6a79720 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:57.887474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 442/873] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:31:57 2022] POST /identity/v3/services => generated 252 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:31:58.439222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642df7-c409-4d62-91d8-29c881299dce None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:58.439773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642df7-c409-4d62-91d8-29c881299dce None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:58.439850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642df7-c409-4d62-91d8-29c881299dce None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:58.441483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 432/874] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:58.446651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:58.447042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:58.447199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:58.466370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:58.467606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:58.550683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 443/875] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:58 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:31:58.574340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642df7-c409-4d62-91d8-29c881299dce None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:58.604058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:58.686430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642df7-c409-4d62-91d8-29c881299dce None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:58.722612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:58.723638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:58.724159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:58.724639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:58.737950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:31:58.743271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:58.744537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:31:58.745762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:58.748349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 433/876] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:31:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:58.759410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:58.849388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:58.858606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73411c-38bc-43c2-b9aa-a6bc468bd609 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:58.895160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:58.896032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:58.896311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:58.896633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:58.897393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:58.897696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:58.899101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826c7c4-47a7-4436-a209-eb5db2eaa087 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:58.908492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 444/877] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:31:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:58.914410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.016180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.035705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3abbf5-33b7-4ea6-b9a9-ae1f406aa358 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.074856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.076009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.076525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.077017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.077122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4871-778b-423b-90f5-9f0b8857c872 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.077423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4871-778b-423b-90f5-9f0b8857c872 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.077700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4871-778b-423b-90f5-9f0b8857c872 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.079381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 445/878] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:59.084661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.084946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.085229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.091064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.092837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.104593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:59.105985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:31:59.115332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:59.116277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:59.117185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:31:59.117185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:31:59.117185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:31:59.117185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:59.117601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 434/879] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:59.123216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.191538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 446/880] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:59 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:31:59.209897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.243304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be51e9d-f110-424f-b443-43900bda8639 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.283669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.284216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.284725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.285008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.286855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:59.287165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.288575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.296339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.302427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 435/881] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:31:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:59.308590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.311456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.330732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c54c-0469-41f6-b24c-4696b37d98c7 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.368374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.369275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.369729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.370071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.371094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.372693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.395645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 447/882] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:31:59 2022] POST /identity/v3/services => generated 270 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:31:59.436802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5961a-eab6-47da-95e2-cbe534973848 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.482369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.483204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.483400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.483575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.492121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.493603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:31:59.507545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:31:59.509828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:31:59.512227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 436/883] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:31:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:31:59.515394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.629198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b517-9c44-4840-a202-ef1e758e67eb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.666413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.667103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.667406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.667685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.668497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:31:59.668805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.670313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b4376-e13e-4d45-8648-05099739f165 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.688779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 448/884] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:31:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:31:59.694247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:31:59.756264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.805875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0deb0f-9874-4b9f-8a92-edd7a5d47025 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:31:59.841647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:31:59.842326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.842617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.842890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.914827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:31:59.916374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ff90-069c-47f4-a2bf-b8046960e36c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:31:59.965635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b48f0-020e-4d78-b5d0-5f66ea4dabe8 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.965635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b48f0-020e-4d78-b5d0-5f66ea4dabe8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.965786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b48f0-020e-4d78-b5d0-5f66ea4dabe8 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.967306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 449/885] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:31:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:31:59.972810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7007af-152e-46e7-8569-37c578c7771c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:31:59.973080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7007af-152e-46e7-8569-37c578c7771c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:31:59.973371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7007af-152e-46e7-8569-37c578c7771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:31:59.980441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.984944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:31:59.993894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2d7007af-152e-46e7-8569-37c578c7771c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:31:59.995038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2d7007af-152e-46e7-8569-37c578c7771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:00.034087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 437/886] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:31:59 2022] GET /identity/v3/auth/tokens => generated 1374 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:00.035583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705e022-7118-4706-bf24-9e0a6acc11cd None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.035870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705e022-7118-4706-bf24-9e0a6acc11cd None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.036143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705e022-7118-4706-bf24-9e0a6acc11cd None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.037519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 438/887] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:00.040216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705e022-7118-4706-bf24-9e0a6acc11cd None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.074740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 450/888] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:31:59 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:00.076653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.076997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.077338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.102656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:00.104208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:00.152519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705e022-7118-4706-bf24-9e0a6acc11cd None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.180079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 451/889] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:00.180079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.196084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.197216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.197667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.197958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.209188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.211171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:00.226739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:00.227745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 439/890] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:00.233415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.238678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.254539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.297190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82a15f-0aab-41fd-a0c4-2769e0611bd6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.332185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.332830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.333110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.333389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.334018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.335403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.339137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7c5e2-95be-41ec-9140-f9d5412e22a0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:00.344636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:00.345603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:00.346426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 452/891] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:00.347242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.379735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.380381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.380661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.380956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.381624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.382992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:00.392299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:00.393301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:00.394144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 440/892] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:00.394937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.465487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2877d-4d41-4716-8cc8-1d93b190df51 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.471526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.493444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.504552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.505185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.505470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.505780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.506512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:00.506823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.506916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3670ed4-37c1-4eea-a282-5e89363bf2c6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.508347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.520796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 453/893] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:00.526513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.543941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.544728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.545012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.545290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.545972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:00.546280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.547687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.552565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 441/894] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:00.553348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.640577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ad65a-b7a5-4fed-af63-31531f2abb4b None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.663269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeedec-8563-4ba7-9d40-1ec0433baf8a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.679159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.680064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.680532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.680978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.681794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:00.682465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.684226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.694195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 454/895] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:00.694997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.697232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.697918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.698232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.698668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.700829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.706804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.708722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:00.721811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:00.722974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:00.723889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 442/896] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:00.724370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.754714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.809083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46052-6d1c-472c-8f70-0671762e2f3c None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.827821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a574ee-6544-49fc-b3e1-1fa2414be2ca None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:00.845301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.845927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.846212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.846485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.847165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:00.847501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.848879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.855296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 455/897] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:00.856535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.863977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:00.864846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:00.865302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:00.865748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:00.866635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:00.867112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:00.868688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:00.873991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 443/898] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:00.874975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:00.957652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:00.995762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53541db-5e28-49cc-91db-66a5861893b5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:01.010259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5369e-4157-4400-845a-1bdd7fe60515 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:01.017113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:01.044077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:01.044751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.045127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.045371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.046479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:01.046591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:01.048048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:01.057036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:01.057804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.058116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.058343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.059113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] RBAC: Adding query filter params (interface=public, service_id=13d076eec0904ab6aaad80bd3acbc823, region_id=RegionOne) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:01.059457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:01.060843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:01.061368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 456/899] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:01.067404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:01.069005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 444/900] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:32:00 2022] GET /identity/v3/endpoints?service_id=13d076eec0904ab6aaad80bd3acbc823&interface=public®ion_id=RegionOne => generated 195 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:01.075061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:01.189007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1d72-3f2e-4174-831d-48b03ded2f43 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:01.196230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ba3-21cd-48e1-821a-11e95d63bf80 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:01.225061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:01.233776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:01.234420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.234773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.234972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.236024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] RBAC: Adding query filter params (role.id=0587a1825fb04a1da9c20889f2b37fbd, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7fb919f2578a4e57b25f27b97822e0d1) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:01.236155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:01.237852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769b748-ed8c-4d05-8ae5-e973bed6ef1f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:01.240830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:01.241723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.242377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.243156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.244054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:01.249521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 457/901] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:01 2022] GET /identity/v3/role_assignments?user.id=7fb919f2578a4e57b25f27b97822e0d1&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=0587a1825fb04a1da9c20889f2b37fbd => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:01.249691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876301-082a-47f0-bdef-f80840d0198b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:01.260959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 445/902] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:01 2022] GET /identity/v3/services => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:32:01.494966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebedca-d5cd-4e87-b529-69700eb1f343 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.495439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebedca-d5cd-4e87-b529-69700eb1f343 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.495439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebedca-d5cd-4e87-b529-69700eb1f343 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.497099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 458/903] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:01.506501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.506501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.506501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.524296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:01.526557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:01.603486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 446/904] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:01 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:01.619785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebedca-d5cd-4e87-b529-69700eb1f343 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:01.689850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:01.787343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebedca-d5cd-4e87-b529-69700eb1f343 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:01.823717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:01.824364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:01.824641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:01.824913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:01.825545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:01.826915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:01.836206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:01.837239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:01.838645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 459/905] 10.222.0.100 () {56 vars in 1137 bytes} [Fri Aug 5 20:32:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:01.843759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:02.045002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7d0d-86f5-4fde-bf2d-991cfda20b0d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:02.079747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:02.118273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:02.118999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:02.119320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:02.119665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:02.120448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:02.120758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:02.122156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:02.128055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 447/906] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:01 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:02.133455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:02.240023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287ee6e-b67f-4592-9443-4d57b2f3cff0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:02.241519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:02.278122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:02.278741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:02.279016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:02.279287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:02.279995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:02.280297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:02.281664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:02.287333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 460/907] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:02 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:02.293488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:02.415749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc2e0c-e2c8-4d8a-b93d-35b7f9a58b91 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:02.450832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:02.451492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:02.451773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:02.452043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:02.452805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] RBAC: Adding query filter params (interface=public, service_id=55f136be9c8247a6921f7c7323a51002, region_id=RegionOne) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:02.453114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:02.454554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f43a7-94d0-40e1-b78e-0c4a2957ac4e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:02.460084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 448/908] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:32:02 2022] GET /identity/v3/endpoints?service_id=55f136be9c8247a6921f7c7323a51002&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:02.465847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:02.576422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dca88-c7f7-4823-8b16-cc21fac746c6 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:02.613962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:02.614608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:02.614882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:02.615148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:02.615837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:02.617200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce571d9-b91b-43b4-b016-48d3f350ef5c None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:02.624008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 461/909] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:02 2022] GET /identity/v3/services => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:32:03.080495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2b87-3c99-48b4-bc39-53c865ca118e None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.081494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2b87-3c99-48b4-bc39-53c865ca118e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.081972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2b87-3c99-48b4-bc39-53c865ca118e None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.083643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 449/910] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:03.089016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bb0a-9c70-4188-ae96-ffc352e99e58 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.089558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bb0a-9c70-4188-ae96-ffc352e99e58 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.090028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bb0a-9c70-4188-ae96-ffc352e99e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.109775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-8598bb0a-9c70-4188-ae96-ffc352e99e58 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:03.111299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8598bb0a-9c70-4188-ae96-ffc352e99e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:03.137154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:03.183780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 462/911] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:03 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:03.206151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2b87-3c99-48b4-bc39-53c865ca118e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.255953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:03.318594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2b87-3c99-48b4-bc39-53c865ca118e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:03.354647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:03.355335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.355648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.355924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.356652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:03.358022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880af81-c144-49ca-adc1-f33a20c59c5d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:03.376093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 450/912] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:32:03 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:03.449428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d19c4a-99b7-4682-9f69-99ca52709d73 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.449780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d19c4a-99b7-4682-9f69-99ca52709d73 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.450030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d19c4a-99b7-4682-9f69-99ca52709d73 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.451742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 463/913] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:03.460178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.460713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.461167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.481625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:03.483237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:03.514921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db214c-9ebb-4a9c-a817-5f2d0ee1835e None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.515113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db214c-9ebb-4a9c-a817-5f2d0ee1835e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.515433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db214c-9ebb-4a9c-a817-5f2d0ee1835e None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.518172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 464/914] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:32:03.522681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.522969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.523249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.542525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:03.543796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:03.572978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 451/915] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:03 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:03.595517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.629631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 465/916] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:03 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:03.643333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:03.654596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.715125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9f65f-223c-42cb-a68d-9f6856be3535 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:03.753024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:03.753816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.754158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.754529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.767688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:03.773444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:03.774564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:03.776706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 452/917] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:32:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:03.782321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:03.782860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.803815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269834-1472-4d4b-b53e-63a08c9ab116 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:03.844209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:03.845029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.845318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.845593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.846281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:03.847700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:03.857195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:03.858185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:03.859042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 466/918] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:03.864264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.910596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:03.926388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8baa-b9e0-43bb-a37e-3050363d5a15 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:03.964546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:03.965634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:03.966128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:03.966603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:03.968241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:03.968763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:03.970367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:03.984186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 453/919] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:03.985416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:03.994670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf0b6-d019-4829-b172-dad88dabd423 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.029053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.029841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.029954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.030219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.030907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:04.031216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.032645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.038324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 467/920] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:03 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:04.043764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.067587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.093677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471043-d605-40cb-9be4-e1078be03492 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.132145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.133455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.133967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.134705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.151489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.153827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.172550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206ef5-4c3a-41f3-9817-eb905118f0a0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:04.174460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:04.175399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:04.176306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:04.176306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:04.176306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:04.176306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:04.182342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 454/921] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:04.182681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.192011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.222925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.223586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.223863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.224134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.225247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:04.225552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.227432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.239452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 468/922] 10.222.0.100 () {56 vars in 1119 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:04.240322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.311505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62596116-1e9d-4233-a048-027af4b7e2a5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.327380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.348411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.349082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b12a58-0c7e-4364-8446-5d354817c218 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.349637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.350152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.350632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.351654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:04.352162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.354025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.366911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 455/923] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:04.372529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.389564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.390235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.390478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.390755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.391506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.392893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.419459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 469/924] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:04 2022] POST /identity/v3/endpoints => generated 348 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:04.471456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.524617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34171037-11f7-4c01-9349-4d9909b8b32e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.574040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.575172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.575678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.576132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.585700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.587695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0a482f3c-d3a6-4942-a400-373cc50db600 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:04.602792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:04.603972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:32:04.604925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:04.607390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 456/925] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:04.616363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.686558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38b18-6da9-4efb-9087-f8bf56248903 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.686937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38b18-6da9-4efb-9087-f8bf56248903 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.687129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d38b18-6da9-4efb-9087-f8bf56248903 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.689785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 457/926] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:32:04.694040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.694334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.694617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.713869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:04.715209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:04.727351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1eb2-8409-40a5-8ca9-dcadf06e4312 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.763311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.764161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.764440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.764710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.765511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:04.765816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.767520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.776666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.791970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 470/927] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:04.799387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.799518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 458/928] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:04 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:04.815998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.870748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:04.925163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b105c1-9a0b-4426-b2f0-f08abeae92bc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.932466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d608d4-9f0b-4f59-96d5-4374eddc96fb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:04.963617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.964468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.964751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.965028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.965671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.967057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:04.980033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:04.980033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:04.980033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:04.980033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:04.980337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:04.981174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:04.981991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 459/929] 10.222.0.100 () {56 vars in 1137 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:04.988199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:04.992678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:04.994557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:05.012145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:05.013085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:05.014031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:05.014031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:05.014031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:05.014031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:05.020580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 471/930] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:05.021774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.077308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.094573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d1256-5712-41c2-b33d-aa547fc9e29b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.108961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.130929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.131695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.132078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.132583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.133234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:05.133640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.135531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.139153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a1a6-5bf2-46bc-9f64-ea906e60037a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.145570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 460/931] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:04 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:05.146583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.177890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.178932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.179348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.179867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.180766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:05.181236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.183520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.196775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 472/932] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:05.204219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.250823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bf4fa-c77e-42dc-829e-698d816a4029 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.286036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.286781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.287135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.287522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.288516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:05.288638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.290180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.300419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 461/933] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:05.301599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.317954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe142e-dbc1-474a-b737-54f9a93595dd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.328950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.348734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.361419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.362466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.362970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.363413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.371293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.373042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:05.385420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:05.386525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:05.387667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:05.394372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 473/934] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:05.395604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.411095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb0f5-c2e5-4023-a6cf-2bf1b409ac6e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.446081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.446874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.447250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.447975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.448758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.450257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190a8f-94da-4419-a975-3f51996b8474 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.475531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 462/935] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:05.525479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e0b3-6509-40b3-a576-7996be9c8b5e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.571469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.572524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.573154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.573621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.574627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:05.575102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.576728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.577224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0389e8-f393-41b5-af3c-9b3217c30bf1 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.577718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0389e8-f393-41b5-af3c-9b3217c30bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.578202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0389e8-f393-41b5-af3c-9b3217c30bf1 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.580168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 463/936] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:05.585954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.586549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.587049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.591180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 474/937] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:05.597611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.613043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:05.614667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:05.647124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.705753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 464/938] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:05 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:05.729201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:05.740935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f871a6-ee93-40e9-a8fd-3c66ef89112e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.761858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:05.778410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.779092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.779383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.779685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7fb919f2578a4e57b25f27b97822e0d1/roles/0587a1825fb04a1da9c20889f2b37fbd` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.781904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=7fb919f2578a4e57b25f27b97822e0d1, role_id=0587a1825fb04a1da9c20889f2b37fbd)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.783344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.802178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 475/939] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:32:05 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7fb919f2578a4e57b25f27b97822e0d1/roles/0587a1825fb04a1da9c20889f2b37fbd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:32:05.861272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e446a8-d604-4959-9633-2564a80d52ef None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:05.904557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:05.905539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:05.906015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:05.906464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:05.907281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:05.908949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:05.920070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:05.921134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:05.921999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:05.924624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 465/940] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:05.931158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:06.039186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:06.057570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8ab4c-0690-482a-ab63-05053f837543 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:06.092913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:06.093649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.094244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.094597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.095351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:06.095752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:06.097250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:06.102454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 476/941] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:05 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:06.108702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:06.205029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:06.214373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d087-6de3-4d9d-a1ed-4505efdc33d0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:06.249159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:06.249784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.250066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.250342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.251029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:06.251337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:06.252735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:06.257959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 466/942] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:06 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:06.263984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:06.367487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032254d-a48a-462f-9c07-cf30dfe2f566 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:06.403063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:06.403724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.403999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.404266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.405026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] RBAC: Adding query filter params (interface=public, service_id=fd033a1efd1f43c2859a8ec7a55849dc, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:06.405338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:06.406703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43411fb-b5f0-4210-905c-2a6a55f81901 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:06.412632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 477/943] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:32:06 2022] GET /identity/v3/endpoints?service_id=fd033a1efd1f43c2859a8ec7a55849dc&interface=public®ion_id=RegionOne => generated 195 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:06.418635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:06.521362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e18fa-9810-475f-89ce-a80465549037 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:06.548575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7744a-e6ce-4462-95d8-88d1ee23cf3d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.548852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7744a-e6ce-4462-95d8-88d1ee23cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.549120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7744a-e6ce-4462-95d8-88d1ee23cf3d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.550589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 478/944] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:32:06.555793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.556267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.556800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.561178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:06.561817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.562101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.562379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.563101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:06.564685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:06.572923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 467/945] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:06 2022] GET /identity/v3/services => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:32:06.579666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:06.581187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:06.590829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:06.667485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 479/946] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:06 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:06.686738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:06.710903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:06.809663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28002-2d0e-4407-ad5e-d4d5b6d4e2be None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:06.845085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:06.845954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:06.846379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:06.846793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:06.847652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:06.849243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:06.852069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING keystone.server.flask.common [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 20:32:06.871097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.sql.core [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 20:32:06.871097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 20:32:06.871097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [parameters: {'id': 'aa2c6a2e174545c38647ddef1730b265', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 20:32:06.871097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa2c6a2e174545c38647ddef1730b265.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa2c6a2e174545c38647ddef1730b265. Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:32:06.878842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result.read() Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 20:32:06.879824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application yield resource Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise self.value Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application session.commit() Aug 05 20:32:06.881005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.session.flush() Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application compat.raise_( Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 20:32:06.882091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 20:32:06.883224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application result.read() Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:32:06.884166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [parameters: {'id': 'aa2c6a2e174545c38647ddef1730b265', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:06.885258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:06.886049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa2c6a2e174545c38647ddef1730b265. Aug 05 20:32:06.886945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:06.889171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 468/947] 10.222.0.100 () {60 vars in 1145 bytes} [Fri Aug 5 20:32:06 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:06.899453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:07.004043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952fca-4241-4f68-83db-e3ca8545e3e5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:07.039610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:07.040268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.040553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.040833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.047972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:07.049442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-b252dcd9-4b2d-45d1-8dc2-3abecb4573bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:07.061307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:07.063258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:07.065397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:07.071401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 480/948] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:07.073077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:07.155011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:07.181853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0e13-68c7-4457-9bfa-3be651150044 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:07.217731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:07.218654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.219084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.219537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.220421 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:07.220919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:07.222831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1a5f-1a50-41d9-85a9-5bc1c3808b6f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:07.247486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 469/949] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:07 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:07.669718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9146-4cab-45b6-992b-6bbe0ef3bb05 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.669718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9146-4cab-45b6-992b-6bbe0ef3bb05 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.669718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9146-4cab-45b6-992b-6bbe0ef3bb05 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.670653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 481/950] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:07.676089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5caa-60b8-4651-9957-cdb9508b9d71 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.676603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5caa-60b8-4651-9957-cdb9508b9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.677097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5caa-60b8-4651-9957-cdb9508b9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.696159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-917b5caa-60b8-4651-9957-cdb9508b9d71 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:07.698092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-917b5caa-60b8-4651-9957-cdb9508b9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:07.768531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 470/951] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:07 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:07.790489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d9146-4cab-45b6-992b-6bbe0ef3bb05 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:07.794418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:07.865566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6395ea-298a-4ff0-8d67-695a16b7ef69 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.865857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6395ea-298a-4ff0-8d67-695a16b7ef69 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.866143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6395ea-298a-4ff0-8d67-695a16b7ef69 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.867965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 471/952] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:07.873709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.874285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.874780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.893671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:07.895174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:07.906626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d9146-4cab-45b6-992b-6bbe0ef3bb05 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:07.942574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:07.943151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:07.943477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:07.943757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:07.944398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:07.945777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:07.955204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:07.956257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:07.957311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 482/953] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:07.964298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:07.981252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:07.995412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 472/954] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:07 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:08.020561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.051136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:08.088531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328782-3beb-414c-a48d-96cf60cdf1e8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.124196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.124991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.125371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.125743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.126522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:08.126846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00aed3-e41e-46d3-934d-188b1087be36 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.126974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.128535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.138786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 483/955] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:07 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:08.139776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.165327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.166638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.167091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.167587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.178685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:08.184143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:08.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:08.186510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:08.188970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 473/956] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:08.194957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.260955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22bb1-47bc-44f1-a95b-a994133286b2 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.264213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:08.292115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:08.302082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.302869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.303164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.303498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.304300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:08.304612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.306004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.311864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 484/957] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:08.313594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b2678-e505-47ff-a363-092a7232d588 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.354547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.355228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.355540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.355815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.356557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:08.356861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.358262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.368321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 474/958] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:08.374156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.487398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b06f6-fe89-4b9a-bddc-78a474f07a78 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.522689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.523347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.523654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.523932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.535666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.537139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:08.557095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:08.558028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:08.559562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:08.559562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:08.559562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:08.559562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:08.559562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 485/959] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:08.564080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.673593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9b32-df37-409a-80d2-436c4a581d04 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.691287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:08.709118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.709742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.710022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.710305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.710991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:08.711293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.712684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40643c9-c617-4c7d-9d51-400dad0d3e84 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.725126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 475/960] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:08.730527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.780487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:08.795998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d36d5-4914-4350-8b98-76e0af198808 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d36d5-4914-4350-8b98-76e0af198808 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.796559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d36d5-4914-4350-8b98-76e0af198808 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.798171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 476/961] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:08.803254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.803565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.803848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.825105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:08.826305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:08.840086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4250d-3435-48ba-9cb8-064905d3aace None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:08.875554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:08.876386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:08.876715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:08.876994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:08.885140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:08.886624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:08.898876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:08.899900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:08.901543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 486/962] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:08.905909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:08.915612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 477/963] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:08 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:08.936606 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.029845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996f280-2371-44f0-b19c-71e0f64f6db1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.039108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.070785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73461478-1169-43bf-8a04-46aa98a4b524 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.072829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.073788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.074262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.074718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.075720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:09.076206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.077893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.082171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.105597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 487/964] 10.222.0.100 () {56 vars in 1154 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:09.107137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.112424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.113090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.113375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.113677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.114325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.115715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:09.127488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:09.128530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:09.129414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:09.131436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 478/965] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:09.135624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.240493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec28c5-d766-400d-a148-bdb5f8d6643d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.248114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3abf-2445-449e-b5fd-0631bfc8d306 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.282082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.283003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.283287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.283605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.289290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.290097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.290579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.291096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.292107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:09.292583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.294547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.301226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 479/966] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:09.306569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.323201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.354675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.366473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.368337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f1fe-edcb-411b-b9e3-2920048d71e2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.434590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88939-3e11-4856-81da-664a4aaf8a2e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.474667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.475404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.475696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.475971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.476663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:09.476974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.478419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d07eb5-e8eb-4585-a6c7-873c874e6706 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.483698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 488/967] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/auth/tokens => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:09.483698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a6e2-6ed1-48ea-9efa-c78eb6374da4 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.483698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a6e2-6ed1-48ea-9efa-c78eb6374da4 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.483698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a6e2-6ed1-48ea-9efa-c78eb6374da4 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.486411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 489/968] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:09 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:09.487196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a6e2-6ed1-48ea-9efa-c78eb6374da4 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.487856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 480/969] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:09.491572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.491572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.491572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.508717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:09.510027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:09.556408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.586109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 481/970] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:09 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:09.587146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.612560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a6e2-6ed1-48ea-9efa-c78eb6374da4 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.621590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.649415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.650057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.650526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.650722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.661450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.662905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:09.678000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:09.678932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:09.679853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:09.679853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:09.679853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:09.679853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.679853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 490/971] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:09.680694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.703844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd71e26-549a-4286-a74d-f36d082a0e54 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.739155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.739822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.740106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.740382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.741099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.742480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.763109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 482/972] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:09 2022] POST /identity/v3/endpoints => generated 351 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:09.764023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.807765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f14af-493c-41d4-a364-f07a9fe7420a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.844006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.865571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.866219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.866511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.866796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.867822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.870248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.872661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:09.875472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING keystone.server.flask.common [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 20:32:09.895845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.sql.core [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 20:32:09.895845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 20:32:09.895845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [parameters: {'user_id': '632746d6296948eab4b6a176c2613978', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 20:32:09.895845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 20:32:09.896329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b62142-1a1b-46ee-bb87-2d5c3b125367 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application result.read() Aug 05 20:32:09.915349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:32:09.916510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application yield resource Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application next(self.gen) Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise self.value Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application session.commit() Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 20:32:09.917512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self.session.flush() Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application compat.raise_( Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 20:32:09.918433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 20:32:09.919558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application conn.query(q) Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application result.read() Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 20:32:09.920556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [parameters: {'user_id': '632746d6296948eab4b6a176c2613978', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:09.921408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 20:32:09.922278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 491/973] 10.222.0.100 () {60 vars in 1136 bytes} [Fri Aug 5 20:32:09 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:09.923490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:09.956587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:09.957747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:09.958080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:09.958649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:09.959473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:09.959786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:09.961852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:09.981021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 483/974] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:09.987451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:10.060426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8e21-fec6-4e3e-99a1-d337f0f3c041 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.109015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.110084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.110625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.110905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.116239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2c3ed-059b-4fab-98ea-42f2c84f7bd7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.122641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.126230 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:10.142502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:10.143576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 20:32:10.144645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:10.145198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 492/975] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:10.151544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:10.161355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.162021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.162359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.162640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.171971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.174146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:10.189978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:10.192080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:10.193359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 484/976] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:10.198037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:10.198205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:10.208857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:10.270676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27242-9f5a-4bb3-91ca-537ddc32d206 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.307391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.308466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.308959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.309428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.310375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaffd9c-7240-413a-885c-bc2c845b648c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.311019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:10.311561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.313233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2c7d8-a7a9-4665-ae83-660522f9908e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.348195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.348895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.349184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.349465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.350232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:10.350542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.352020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.359600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 493/977] 10.222.0.100 () {56 vars in 1106 bytes} [Fri Aug 5 20:32:10 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:10.361166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d746b-b7aa-4c6c-8998-fc1582d982b7 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.361449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d746b-b7aa-4c6c-8998-fc1582d982b7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.361722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d746b-b7aa-4c6c-8998-fc1582d982b7 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.363411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 494/978] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:10.367460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 485/979] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:10.373416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:10.373718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.373987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.374259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.393902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:10.395549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:10.451943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:10.491569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 495/980] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:10 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:10.500998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fb72-f72e-406e-a856-dac0ce5c8800 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.513279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:10.548286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:10.557649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.558430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.558663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.558938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.560448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] RBAC: Adding query filter params (role.id=0587a1825fb04a1da9c20889f2b37fbd, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7fb919f2578a4e57b25f27b97822e0d1) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:10.560448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.561670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b620c-0de7-4a1c-8cf9-1f854e4d5dd9 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.573439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 486/981] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:10 2022] GET /identity/v3/role_assignments?user.id=7fb919f2578a4e57b25f27b97822e0d1&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=0587a1825fb04a1da9c20889f2b37fbd => generated 610 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:10.654222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacc01-590b-450a-84f8-116ab64b045e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:10.698891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:10.700006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:10.702731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:10.703322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:10.704312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:10.705896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e63fd-faed-4362-83f0-05477e9f29b8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:10.728356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 496/982] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:32:10 2022] POST /identity/v3/services => generated 243 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:11.940248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f115f-68ed-4ee2-8db6-ea412dd47924 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:11.940798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f115f-68ed-4ee2-8db6-ea412dd47924 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:11.940798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f115f-68ed-4ee2-8db6-ea412dd47924 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:11.942123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 487/983] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:11.947728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:11.948161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:11.948237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:11.969587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:11.970785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:12.047807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 497/984] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:11 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:12.069603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f115f-68ed-4ee2-8db6-ea412dd47924 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.173739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f115f-68ed-4ee2-8db6-ea412dd47924 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.204190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:12.211661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.212430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.212759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.213224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.213885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.215270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:12.224641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:12.225600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:12.226437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.230883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 488/985] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:12.232187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.242841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:12.340818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc955-0fba-439f-b967-5b1d5a37ef1e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.395879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.396500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.396781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.397013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.397792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:12.398095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.399644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.409851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 498/986] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:12.411473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.518020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47557-6ce5-430f-80f3-23abfd8223c9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.552271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.552897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.553178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.553456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.554133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:12.554438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.555848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bc8ce-2ce0-4c42-a4ae-dce63ea4e7a5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.561282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 489/987] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:12.567060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.650104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:12.664084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f7f8-07b2-42dc-ab40-db851492b85d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.664983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f7f8-07b2-42dc-ab40-db851492b85d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.665755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f7f8-07b2-42dc-ab40-db851492b85d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.668252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 490/988] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:12.673100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.673395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.673670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.685005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717b1ee-a77e-4ce0-941c-7c9cdfd8c608 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.692098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:12.693298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:12.723900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.724699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.724983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.725583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.726365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] RBAC: Adding query filter params (interface=admin, service_id=fd033a1efd1f43c2859a8ec7a55849dc, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:12.726699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.728156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.733773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 499/989] 10.222.0.100 () {56 vars in 1254 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/endpoints?service_id=fd033a1efd1f43c2859a8ec7a55849dc&interface=admin®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:12.739130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.754828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:12.771528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 491/990] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:12 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:12.793595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:12.842977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59daae-6e10-47d1-a0a7-389e23304ed8 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.878826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.879469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.879749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.880027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.880686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.882068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d03da-ff59-4435-b32f-813db053680a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.883989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:12.890287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 500/991] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:32:12.891897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa44c5-2010-432c-99d0-4b0963fa8639 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.892190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa44c5-2010-432c-99d0-4b0963fa8639 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.892471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa44c5-2010-432c-99d0-4b0963fa8639 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.895395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 501/992] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:12.899345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.899796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.900060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.909291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255b7d0-2ebd-420e-a3f5-05db112c7750 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:12.920619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:12.921870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:12.952617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:12.953287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:12.953563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:12.953833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] PATH_INFO: `/v3/services/image` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:12.954470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:12.955902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:12.970867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:12.972090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:12.973069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 492/993] 10.222.0.100 () {56 vars in 1110 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:12.978411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.012178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 502/994] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:12 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:13.034347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.051125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:13.100578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1d698-8db0-4403-9b6e-4fe0ba14cd1d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.136517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.137141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.137415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.137691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.138380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:13.138687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.140099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.149729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 493/995] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:12 2022] GET /identity/v3/services?name=image => generated 123 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:13.150861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.154221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233bc0-4733-487d-a3d6-565028398fa9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.185337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:13.191464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.192120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.192400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.192675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.193402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.194811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:13.204269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:13.205298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:13.206878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 503/996] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:13.211488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.261840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5240-4a47-441e-a6fc-2ac9411094b0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.279070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:13.299415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.300042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.300330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.300608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.301341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] RBAC: Adding query filter params (type=image) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:13.301649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.303242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.308470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 494/997] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/services?type=image => generated 123 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:13.322779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f0916-88b5-4708-8150-fca1d485ccce None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.364686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.365333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.365582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.365883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.366581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:13.366853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.368332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.374638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 504/998] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:13.380343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.489167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82857-4963-4ed0-a5c2-a9f462252dce None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.523379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.524020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.524335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.524614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.525379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:13.526255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.527700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.532823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 495/999] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:13.538805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.601646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:13.650599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa48-5259-439c-b7d1-52abca03649f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.686528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.687145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.687445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.687725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.688486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] RBAC: Adding query filter params (interface=public, service_id=4edf7cc9405041ff861174b125489ab6, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:13.688795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.690235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e00c-6544-49da-a0bd-dd2418271078 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.695874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 505/1000] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/endpoints?service_id=4edf7cc9405041ff861174b125489ab6&interface=public®ion_id=RegionOne => generated 195 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:13.701372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:13.748122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:13.804685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a7fb-8e8c-4c16-ae21-dcbbeb1bacb5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:13.838753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:13.839548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:13.839960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:13.840261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:13.841024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:13.842491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b3579-5e96-485a-9aee-808bcbffa69f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:13.849269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 496/1001] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:13 2022] GET /identity/v3/services => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:32:14.914241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1bd08-ba51-4ca2-8e1b-a420baec9dfa None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:14.914826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1bd08-ba51-4ca2-8e1b-a420baec9dfa None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:14.914826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1bd08-ba51-4ca2-8e1b-a420baec9dfa None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:14.916660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 506/1002] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:14.921937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:14.922372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:14.922561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:14.942643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:14.943932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:15.021427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 497/1003] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:14 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:15.044199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1bd08-ba51-4ca2-8e1b-a420baec9dfa None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:15.150096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1bd08-ba51-4ca2-8e1b-a420baec9dfa None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:15.173916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:15.186590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:15.187253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.187559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.187829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.188493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:15.189897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-bb4a8dda-ad59-4e2d-97c0-a57992401ab4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:15.199612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:15.200617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 20:32:15.201472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:15.203686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 507/1004] 10.222.0.100 () {56 vars in 1131 bytes} [Fri Aug 5 20:32:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:15.207044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:15.248456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:15.312855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed93a-b328-4629-aa28-18ac58766c3d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:15.338799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e9f6-b6e5-42da-b943-86ee5ec8e1f0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.339797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e9f6-b6e5-42da-b943-86ee5ec8e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.340090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e9f6-b6e5-42da-b943-86ee5ec8e1f0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.341466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 508/1005] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:15.346579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.346862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.347138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.351158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:15.351829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.352110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.352385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.353070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:15.353429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:15.355003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:15.364746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 498/1006] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:15 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:15.366199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:15.366675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:15.367933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:15.440924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 509/1007] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:15 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:15.462994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:15.474467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b314f8-09f5-4a45-8617-40b02c537f15 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:15.476537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:15.510969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:15.511631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.511911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.512181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.512858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:15.513157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:15.514520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:15.519250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 499/1008] 10.222.0.100 () {56 vars in 1127 bytes} [Fri Aug 5 20:32:15 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:15.525611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:15.575408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea7386-05cc-4338-ada6-b84c6359fc3c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:15.592926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:15.612675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:15.613410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.613687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.613956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.614641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:15.616186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601f0e1-48a4-4c25-92b1-2bba21243a01 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:15.628538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24684d-3bef-46fa-84b3-d9c21fa4af25 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:15.639435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 510/1009] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:32:15 2022] POST /identity/v3/services => generated 243 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:15.680395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:15.681292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.681988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.682428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.683453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:15.685027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb02d1-22b3-4611-af9f-6f9a2cbcc129 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:15.704447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 500/1010] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:15.858828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ffcd-de5d-4230-867c-356c5fabd668 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.859189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ffcd-de5d-4230-867c-356c5fabd668 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.859525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ffcd-de5d-4230-867c-356c5fabd668 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.860956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 511/1011] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:15.866470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:15.866765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:15.867036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:15.886668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:15.887893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:15.905729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:15.972866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 501/1012] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:15 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:15.995444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71ffcd-de5d-4230-867c-356c5fabd668 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:16.105161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71ffcd-de5d-4230-867c-356c5fabd668 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:16.139958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:16.140622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:16.140904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:16.141179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:16.141879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:16.143263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:16.152788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:16.153844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 20:32:16.154678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:16.156277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 512/1013] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:16.163388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:16.266165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d700351-7189-4f08-9037-0aabd3734134 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:16.302364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:16.302986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:16.303263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:16.303562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:16.304241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:16.304546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:16.305916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:16.311530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 502/1014] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:16 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:16.317155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:16.371023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:16.438039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f54247-448a-43ec-9f67-f62cfebbb364 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:16.471761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:16.472382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:16.472657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:16.472925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:16.473600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:16.473902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:16.475256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967d699-dd99-4ee7-9079-eeb10bdb4c65 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:16.481889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 513/1015] 10.222.0.100 () {56 vars in 1117 bytes} [Fri Aug 5 20:32:16 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:16.486471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:16.501938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:16.589968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1fd9-6ac8-4d87-8e63-b187f6f31198 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:16.624518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:16.625137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:16.625415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:16.625688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:16.626394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:16.627787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1460a6-89a2-4683-b477-a8c43f128912 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:16.655822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 503/1016] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:16 2022] POST /identity/v3/endpoints => generated 336 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:17.709306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcf0b-337e-42bf-8f41-06bcfaf2a4ba None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:17.709882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcf0b-337e-42bf-8f41-06bcfaf2a4ba None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:17.709882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcf0b-337e-42bf-8f41-06bcfaf2a4ba None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:17.711187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 514/1017] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:17.717080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:17.717505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:17.717676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:17.736351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:17.737512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:17.751601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf176-8a61-4975-b218-7c7d199ceb61 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:17.751866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf176-8a61-4975-b218-7c7d199ceb61 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:17.752139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bf176-8a61-4975-b218-7c7d199ceb61 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:17.753499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 515/1018] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:32:17.758818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:17.759204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:17.759818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:17.778962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:17.780200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:17.814178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:17.835531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 504/1019] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:17 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:17.854503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:17.861285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 516/1020] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:17 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:17.884577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:17.919857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:17.968970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66bc23-4a39-41d6-8b6a-dd2ac3a97735 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:17.994949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4de2a-b117-4210-b36a-ecdd958ecacd None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.006792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.007486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.007835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.008051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] PATH_INFO: `/v3/services/image` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.008820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.010177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:18.019211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:18.020231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:18.021087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 505/1021] 10.222.0.100 () {56 vars in 1110 bytes} [Fri Aug 5 20:32:17 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:18.026255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.034837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.035830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.036113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.036383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.037523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.038956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.040964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 517/1022] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:18.046737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.094881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:18.142530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e340-a0ee-421c-928b-2be001cb92db None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.152954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf8564-8c59-4665-8a51-5450c1241d84 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.154916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:18.179036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.179824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.180111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.180390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.181075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] RBAC: Adding query filter params (name=image) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:18.181462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.183041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.188859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 506/1023] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:18 2022] GET /identity/v3/services?name=image => generated 123 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:18.194401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.196046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.196677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.197229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.197470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.198723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.199743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.227784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 518/1024] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:32:18 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:18.315274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60912ae-0e64-42b6-a80a-25f6081cdd60 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.340397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:18.355770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.356683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.357185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.357608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.358467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:18.358919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.360489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.372012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 507/1025] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:18 2022] GET /identity/v3/services?type=image => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:18.373975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.482611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ee65e-52ac-4650-b1ae-30b51bee6800 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.517459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.518094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.518377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.518652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.519460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] RBAC: Adding query filter params (interface=public, service_id=4acfe926d8884c88bca2f276a0d6b187, region_id=RegionOne) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:18.519777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.521168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e8318-2017-4a9b-bceb-5bc51662a9f8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.526484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 519/1026] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:32:18 2022] GET /identity/v3/endpoints?service_id=4acfe926d8884c88bca2f276a0d6b187&interface=public®ion_id=RegionOne => generated 195 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:18.532338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.636022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a177f8-8033-4a0c-867e-978465b871c1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:18.672265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:18.672890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.673143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.673446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.674101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:18.675493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd23d-c6dc-42a4-b487-520876cdcdc1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:18.683463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 508/1027] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:32:18 2022] GET /identity/v3/services => generated 1966 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:32:18.761278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f469-4baa-498b-9f70-b77c0e1ab75b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.761842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f469-4baa-498b-9f70-b77c0e1ab75b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.761842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f469-4baa-498b-9f70-b77c0e1ab75b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.763741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 520/1028] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:18.770285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:18.770934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:18.770934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:18.792020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:18.793386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:18.849709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:18.873475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 509/1029] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:18 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:18.896922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874f469-4baa-498b-9f70-b77c0e1ab75b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:18.918212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:19.013426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874f469-4baa-498b-9f70-b77c0e1ab75b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.051241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.051925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.052201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.052468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.063122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:19.068233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:19.069168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:19.070073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:19.071461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 521/1030] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:32:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:19.075916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:19.180763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1099-b579-44d4-a835-75fb026fae84 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.215860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.216474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.216767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.217042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.217763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:19.218066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:19.219460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:19.227760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 510/1031] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:19.233708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:19.314354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:19.337887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ae7f-c53c-41c9-844c-0e866f573c0e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.374819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.375512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.375795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.376070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.386600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:19.388113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:19.403338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:19.404321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:19.405217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:19.405217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:19.405217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:19.405217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:19.406155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 522/1032] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:19.410909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:19.458337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:19.518152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115bf89-4c9c-431c-99fc-f973d568db5b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.552426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.553056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.553338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.553614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.554312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:19.554618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:19.556038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:19.569223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 511/1033] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:19.574808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:19.677146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68780114-30bc-449d-a7da-ea692cff7038 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.706524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:19.713477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.714178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.714464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.714740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.722595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:19.724066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:19.735551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:19.736514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:19.737475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:19.739688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 523/1034] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:19.742470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:19.849789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a693-d28f-475c-923d-9786f3f66e57 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:19.851273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:19.885998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:19.886630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:19.886922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:19.887181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:19.888010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:19.888319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:19.889749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:19.907329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 512/1035] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:19.913293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.026261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693e99-b2a9-4448-a45f-780ebacc9877 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.059845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.060457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.060733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.061002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.117710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.129629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.131087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294a8fb-7a8c-480d-aa9a-ce2a4f1af3a2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.230718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 524/1036] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:19 2022] GET /identity/v3/auth/tokens => generated 1973 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:20.236344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.339777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac9f2-31f5-4797-9a99-0ada07456199 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.342076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca2bd-9f55-449b-a8ec-68c1b7ab1d3f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.342455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca2bd-9f55-449b-a8ec-68c1b7ab1d3f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.342827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca2bd-9f55-449b-a8ec-68c1b7ab1d3f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.345128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 525/1037] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:20.349684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.349979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.350258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.370624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:20.371774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:20.380055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.380979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.381451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.381971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.393749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.395428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:20.412206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:20.413343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:20.414413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:20.414413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:20.414413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:20.414413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:20.421125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 513/1038] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:20.421976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.438268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.445743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 526/1039] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:20 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:20.469623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.491477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.532853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f332e-3ac3-4827-83fe-6ae2a3d72616 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.567617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.568255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.568538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.568815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.569523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:20.569836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.571232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.577274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd542c-5c7d-4142-b683-d7b63d2333e0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.585005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 514/1040] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:20.590597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.615182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.615881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.616145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.616412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.617674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.619258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.623485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 527/1041] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:20.626830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.668871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.701919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04796-28ca-4c2d-902e-860ad714a5a7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.722027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.735096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd596b-7ff9-471e-b995-57c797fec537 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.737487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.738135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.738419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.738696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.745407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.746851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-123557af-30bd-4dc9-95d3-e9d0dffbc575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:20.758112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:20.759063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:20.760881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:20.764331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 515/1042] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:20.765510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a3bf-ceab-4646-9681-4bf9583cb93b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.765800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a3bf-ceab-4646-9681-4bf9583cb93b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.766087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a3bf-ceab-4646-9681-4bf9583cb93b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.767377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 516/1043] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:20.768066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a3bf-ceab-4646-9681-4bf9583cb93b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.770451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.771584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.771870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.772142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.772832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.774280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52b9e5-b3b0-4ed5-9793-cabb1b452da8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.811396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 528/1044] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:32:20 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:32:20.811396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.811396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.811396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.818107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:20.819345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:20.885820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a3bf-ceab-4646-9681-4bf9583cb93b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:20.898657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 529/1045] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:20 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:20.917915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:20.923342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:20.924357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:20.925014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:20.925296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:20.925573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:20.926334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:20.926643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:20.928144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:20.946786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 517/1046] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:20.948121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:21.020144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:21.054807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f16c3-1bbb-46bd-8c8a-2936c0e2dab2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:21.075992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cce17-2ef2-49cc-b045-31766c575160 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:21.091169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:21.091855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:21.092138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:21.092412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:21.093042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:21.094420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:21.103605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:21.104973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:21.105834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 530/1047] 10.222.0.100 () {56 vars in 1110 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:21.110593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:21.115725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:21.116439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:21.116798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:21.117082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:21.117879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] RBAC: Adding query filter params (role.id=0587a1825fb04a1da9c20889f2b37fbd, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:21.118190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:21.119687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:21.125829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 518/1048] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:20 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=0587a1825fb04a1da9c20889f2b37fbd => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:21.221079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b197e-bfaa-49b3-81f5-5a46ad6e7ea0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:21.258282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:21.258924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:21.259197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:21.259677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:21.260384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] RBAC: Adding query filter params (name=image) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:21.260686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:21.262076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:21.271766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 531/1049] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:21 2022] GET /identity/v3/services?name=image => generated 123 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:21.273692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:21.336111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:21.382897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070d461-b191-421d-a51d-7b8a68309688 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:21.417346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:21.417997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:21.418274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:21.418540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:21.419210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] RBAC: Adding query filter params (type=image) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:21.419564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:21.420933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfcb6-1540-4d6b-893f-a9b5e7adfffd None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:21.426145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 519/1050] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:21 2022] GET /identity/v3/services?type=image => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:21.431921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:21.434925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:21.536025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194797d-16d0-469e-9a23-cff676f01995 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:21.570926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:21.570926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:21.570926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:21.570926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:21.571578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:21.573205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ec18-c1b7-478e-93b7-8a807945283a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:21.595605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 532/1051] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:32:21 2022] POST /identity/v3/endpoints => generated 329 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:22.980837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b037-0f20-4ac8-98e7-663e2f862500 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:22.981353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b037-0f20-4ac8-98e7-663e2f862500 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:22.981353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b037-0f20-4ac8-98e7-663e2f862500 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:22.982727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 520/1052] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:22.988307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6492fc-2919-49da-8338-63467cfd5442 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:22.988701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6492fc-2919-49da-8338-63467cfd5442 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:22.988892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6492fc-2919-49da-8338-63467cfd5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.007576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6e6492fc-2919-49da-8338-63467cfd5442 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:23.008769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6e6492fc-2919-49da-8338-63467cfd5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:23.067190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.092321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 533/1053] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:22 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:23.115257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b037-0f20-4ac8-98e7-663e2f862500 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.159738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad67a-26fa-4d54-96b1-aecc735abf2f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.161247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad67a-26fa-4d54-96b1-aecc735abf2f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.161726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ad67a-26fa-4d54-96b1-aecc735abf2f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.164121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 534/1054] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:23.169964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.170538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.171173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.196395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:23.198105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:23.228478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b037-0f20-4ac8-98e7-663e2f862500 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.250160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.266915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.267614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.267898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.268170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.271411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 535/1055] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:23 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:23.285350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:23.290295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:23.291412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:23.292251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:23.294451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.296732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 521/1056] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:23.297592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.399311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26cb8c-e5a2-4df4-92ae-ad2f5f2a34fe None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.399721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881202c-bee5-4448-984f-3f4a6c3ed514 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.414392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.434834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.435556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.435789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.436058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.436906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.437531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.437924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.438203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.439033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:23.439339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.440743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.446106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:23.450469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 522/1057] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:23.451312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:23.452249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:23.458241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 536/1058] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:23.458943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.459017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.500835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.559334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea92efa-ad69-461d-bb5a-937de4aa216e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.559555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eac41-4776-4da2-bc01-f2b66fa13666 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.596041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.596244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.596817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.597102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.597378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] PATH_INFO: `/v3/users/8f4ae0220b2744c99777eab4e538def6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.597790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.598329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.598606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.599337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:23.599688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.601071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.609918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 537/1059] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:23.611735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] RBAC: Authorizing `identity:get_user(user_id=8f4ae0220b2744c99777eab4e538def6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.613186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.619417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 523/1060] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/users/8f4ae0220b2744c99777eab4e538def6 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:23.619592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.621039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.658193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.725325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc76b02-1676-4bb7-af17-2e167c459209 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.727799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.731104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dab82-f95c-48d1-a1a1-7c759fd1a591 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.758666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.759267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.759620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.759895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.765564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.766192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.766479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.766759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.771035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.772546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-50b4bdd3-9ea7-4318-8e14-58d1d309e4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:23.787607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:23.788719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:23.789650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:23.789650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:23.789650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:23.789650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:23.789650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 538/1061] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:23.790115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7520-b99d-4281-808e-18f212425647 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.790406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7520-b99d-4281-808e-18f212425647 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.790732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7520-b99d-4281-808e-18f212425647 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.792003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 539/1062] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:23.794932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7520-b99d-4281-808e-18f212425647 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.837674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.839151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e0c7-32fb-41f5-a341-b68e71b71697 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.887752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.901990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7520-b99d-4281-808e-18f212425647 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:23.938305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:23.938504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:23.939024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.939338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.939595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.940294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:23.940603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:23.942018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:23.942676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 524/1063] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:23.943970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:23.944261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:23.944543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:23.958726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 540/1064] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:23.960004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:23.962508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:23.963923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:24.036890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 525/1065] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:23 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:24.037667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.074767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199657-3aa0-48f7-b77f-c443049f34bd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.107658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.108311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.108594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.108870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.110034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.111509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.113197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 541/1066] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:23 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:24.113967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.132470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.142336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eaae7-d238-427b-8590-69f0b2c0c6a4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.171615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.178073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.178732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.179018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.179297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.187161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.188644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:24.200723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:24.201690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 526/1067] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:24.202692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.226095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbbd6-b845-4b77-a9ad-2fc45ca58e16 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.261905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.262540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.262823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.263098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.311681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f2cff-b6b0-4422-b1a9-0acd8afba1cd None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.333434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.334912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.346195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.346828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.347118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.347431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.348215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=242f794a0c654990a9a2f43a8b70f1c0, user.id=8f4ae0220b2744c99777eab4e538def6) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:24.348529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.349952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.352681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.355722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 527/1068] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/role_assignments?user.id=8f4ae0220b2744c99777eab4e538def6&scope.project.id=242f794a0c654990a9a2f43a8b70f1c0&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:24.356857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.418529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.462122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 542/1069] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:24.468442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.478369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4a50-266e-47d0-96c6-e36eb0e365b5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.516931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.517564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.517854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.518133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.518945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:24.519261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.520743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.541445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 528/1070] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:24.547302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.582211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de179-7665-4e8c-985f-29e7d58f4f1d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.600401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.622913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.623903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.624341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.624768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.636650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.638164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:24.653979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:24.654926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:24.655863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:24.655863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:24.655863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:24.655863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:24.655863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 543/1071] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:24.659324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb355-0489-473b-add9-d105bc5925c2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.661574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.674030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:24.698264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.698955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.699216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.699624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.710468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.711980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:24.727300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:24.728327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:24.729487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:24.729487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:24.729487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:24.729487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:24.729487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 529/1072] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:24.734529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.777424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a41da1-e05b-4bf4-bc6e-941141a66c7d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.814288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.814898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.815176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.815498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.816234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:24.816516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.817909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.831057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 544/1073] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:24.859115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4fa33-57c8-4fe5-b565-7c081eb61f49 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:24.899259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:24.899990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:24.900337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:24.900819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:24.901709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:24.902042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:24.903496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:24.918300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 530/1074] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:24.923918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:24.955250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:25.036387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13ad-285e-4f57-b35c-44ffd87206a7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:25.072324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:25.073374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:25.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:25.074320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:25.083926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:25.085998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:25.100596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:25.101948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:25.103100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 545/1075] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:25.106982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:25.135488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:25.211771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b6ee3-024e-4691-bcd8-e2b2c9cfdc6f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:25.247380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:25.248001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:25.248282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:25.248562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:25.249325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:25.249637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:25.251083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43bc8f-2020-4304-8eeb-f166c8f9dd71 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:25.262847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 531/1076] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:25.268988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:25.360515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:25.374423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba49a9-887b-451d-93e8-28eae00e8e87 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:25.408289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:25.408787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:25.409066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:25.409342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/0587a1825fb04a1da9c20889f2b37fbd` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:25.412063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=7cc303860598497f85766448bbdd7e4c, role_id=0587a1825fb04a1da9c20889f2b37fbd)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:25.413505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987cb2a-ec51-4478-b7d7-2afc901cb2a8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:25.427294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 546/1077] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:32:25 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/7cc303860598497f85766448bbdd7e4c/roles/0587a1825fb04a1da9c20889f2b37fbd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:32:26.360863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23da95-1023-4454-ae3b-4e291911781c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:26.361402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23da95-1023-4454-ae3b-4e291911781c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:26.361402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23da95-1023-4454-ae3b-4e291911781c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:26.362687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 532/1078] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:26.368050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:26.368477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:26.368609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:26.387624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:26.388799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:26.458473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 547/1079] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:26 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:26.480670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23da95-1023-4454-ae3b-4e291911781c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:26.573367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:26.591393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23da95-1023-4454-ae3b-4e291911781c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:26.625683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:26.626253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:26.626539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:26.626813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:26.637483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:26.642327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:26.643222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:26.644274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 533/1080] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:26.650087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:26.746718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:26.770870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d114b-9a49-4950-881b-2518a3235d9a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:26.807511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:26.808132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:26.808405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:26.808675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:26.809391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:26.809694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:26.811071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:26.819788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 548/1081] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:26.825631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:26.930720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af1471-d045-46cf-97cd-95d47af3825f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:26.966960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:26.967669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:26.967954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:26.968253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] PATH_INFO: `/v3/users/8f4ae0220b2744c99777eab4e538def6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:26.969552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8f4ae0220b2744c99777eab4e538def6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:26.971008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:26.972673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 534/1082] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:26 2022] GET /identity/v3/users/8f4ae0220b2744c99777eab4e538def6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:26.978688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:27.086805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc2d3-4158-4c18-9ebf-0a432990c440 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:27.123317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:27.124006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.124285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.124560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.125813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:27.127276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbe4e4-b49e-47ce-bec8-95c836affbbe None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:27.129013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 549/1083] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:26 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:27.135769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:27.151828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:27.236905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5106e-81ce-4664-9049-4364c8a368c2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:27.272273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:27.272954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.273233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.273505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0/users/8f4ae0220b2744c99777eab4e538def6/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.276046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=242f794a0c654990a9a2f43a8b70f1c0, user_id=8f4ae0220b2744c99777eab4e538def6, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:27.277486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2030b-9a3e-48e6-8f9a-d5fe82489e2c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:27.292767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 535/1084] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:32:27 2022] PUT /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0/users/8f4ae0220b2744c99777eab4e538def6/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:32:27.408442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b2e9-2873-4c3d-8a9d-b8d9d2aa169d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.409004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b2e9-2873-4c3d-8a9d-b8d9d2aa169d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.409004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b2e9-2873-4c3d-8a9d-b8d9d2aa169d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.410896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 550/1085] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:27.416910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.417433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.417433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.439061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:27.440197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:27.513516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 536/1086] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:27 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:27.537499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b2e9-2873-4c3d-8a9d-b8d9d2aa169d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:27.549776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:27.646770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b2e9-2873-4c3d-8a9d-b8d9d2aa169d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:27.684330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:27.684977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.685255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.685497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.696504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:27.701856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:27.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:27.703860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 551/1087] 10.222.0.100 () {56 vars in 1125 bytes} [Fri Aug 5 20:32:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:27.709448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:27.711842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:27.814693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75037-e4a4-4fdd-9b7f-1ea4c5cf380f None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:27.852134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:27.852758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:27.853193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:27.853193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:27.854210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:27.854519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:27.855940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:27.864150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 537/1088] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:27.870982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:27.940506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:27.976805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e4e0-bf82-4ec0-9c6f-1af0d1e75573 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:28.011334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:28.012018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:28.012301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:28.012574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:28.022982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:28.024508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:28.039783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:28.040855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:28.042307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:28.042307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:28.042307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:28.042307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:28.042307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 552/1089] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:28.046939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:28.121012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:28.159874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e39fa-a4d1-4181-a07d-19f00d5b0a1c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:28.193174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:28.193800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:28.194081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:28.194354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:28.195048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:28.195383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:28.196782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:28.208627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 538/1090] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:28.214665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:28.318347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73ab6-5da8-45d6-af61-f8caa5de302e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:28.338527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:28.357844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:28.358487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:28.358764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:28.359039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:28.366864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:28.368370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:32:28.381184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:28.382351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 20:32:28.383563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:28.387600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 553/1091] 10.222.0.100 () {56 vars in 1098 bytes} [Fri Aug 5 20:32:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:28.388850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:28.492782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea21d-d28a-426e-963f-211458d62493 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:28.516962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:28.528551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:28.529179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:28.529458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:28.529721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:28.530525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:28.530831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:28.532300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:28.550288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 539/1092] 10.222.0.100 () {56 vars in 1138 bytes} [Fri Aug 5 20:32:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:28.556110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:28.665060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946def02-fbc6-4c80-b0ef-81952a86e2a7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:28.701209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:28.701832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:28.702114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:28.702386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:28.752769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:28.776998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:28.778471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:28.880453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 554/1093] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:28 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:28.886588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:28.990386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acab78-6f9a-4fe8-bd7d-85ac9de785d1 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.025708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.026353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.026637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.026906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.037479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.038912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:29.054281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:29.055219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:29.056203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:32:29.056203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:29.056203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:32:29.056203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:29.056203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 540/1094] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:32:29.062091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.146971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.167276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc9dd-fe25-4773-8267-8bc544cda2ff None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.201341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.201960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.202236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.202509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.203204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:29.203541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.204935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452ed0-e4c1-4ea8-9426-99647a7a7e87 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.216805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 555/1095] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:29.222478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.257895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.270991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a711-6cbd-4640-957f-a6560a69ca4f None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.271279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a711-6cbd-4640-957f-a6560a69ca4f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.271585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a711-6cbd-4640-957f-a6560a69ca4f None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.272958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 556/1096] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:29.277998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.278266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.278562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.297120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:29.298323 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:29.326887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d0aa4-552a-4bcc-b04d-5936cd2d49b8 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.361289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.361939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.362224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.362503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.365137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 557/1097] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:29 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:29.369382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.370837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:32:29.382043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:29.382931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:29.384470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 541/1098] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:29.388550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.388782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.459382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.485541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.491670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0a737-fd33-4b04-8108-ceb7575cab3f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.492707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52506-24a5-4add-ba95-f1ab930defc5 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.526368 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.527033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.527137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.527241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.527316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.527565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.527670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.527892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.528321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:29.528629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.530060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.538579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:29.542716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 542/1099] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:29.543595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:29.544701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:29.545548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 558/1100] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:29.549019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.550415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.647878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c0114-bacc-49b4-979d-7b834a7dc6b4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.648643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205fdeb-7f68-423d-ae69-2fa1cf51424e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.676935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.683262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.683923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.684202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.684474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.685229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:29.685534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.686014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.686642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.686928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.687014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.687208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.688042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] RBAC: Adding query filter params (role.id=0587a1825fb04a1da9c20889f2b37fbd, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=7cc303860598497f85766448bbdd7e4c) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:29.688362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.689782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.695206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 559/1101] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:29.696756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 543/1102] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/role_assignments?user.id=7cc303860598497f85766448bbdd7e4c&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=0587a1825fb04a1da9c20889f2b37fbd => generated 610 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:29.701172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.810373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ab976-9f38-4bf5-834d-894dfc495a42 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:29.854331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:29.855035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:29.855322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:29.855628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] PATH_INFO: `/v3/users/8f4ae0220b2744c99777eab4e538def6` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:29.856907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] RBAC: Authorizing `identity:get_user(user_id=8f4ae0220b2744c99777eab4e538def6)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:29.858450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:29.860151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 560/1103] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/users/8f4ae0220b2744c99777eab4e538def6 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:29.866521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:29.891144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:29.980320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083c939-c1d1-42f9-8a96-4d789ba8df28 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:30.014239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:30.014847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:30.015133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:30.015438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:30.085023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:30.086576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:30.108199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:30.193868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 544/1104] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:29 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:30.200496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:30.263318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:30.305934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652d43-b927-4d31-b736-0e7a0fc27f0a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:30.339893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:30.340496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:30.340778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:30.341059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:30.342231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:30.343704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3bec-1563-4aef-a88f-df07a46938d3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:30.345400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 561/1105] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:30 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:30.351945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:30.460474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6283aa8-e51d-47fe-9941-b9fc775bbfa7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:30.479303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:30.498311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:30.498960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:30.499241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:30.499539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:30.500330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=242f794a0c654990a9a2f43a8b70f1c0, user.id=8f4ae0220b2744c99777eab4e538def6) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:30.500644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:30.502072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7e9d-96e4-439b-88bf-8e0013eaccb3 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:30.508257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 545/1106] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:30 2022] GET /identity/v3/role_assignments?user.id=8f4ae0220b2744c99777eab4e538def6&scope.project.id=242f794a0c654990a9a2f43a8b70f1c0&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:32.551676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e556a0-6bbb-4cfb-9090-f2d0aef2e1e8 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:32.552343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e556a0-6bbb-4cfb-9090-f2d0aef2e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:32.552343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e556a0-6bbb-4cfb-9090-f2d0aef2e1e8 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:32.553602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 562/1107] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:32.560770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:32.561530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:32.561632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:32.585659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:32.586843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:32.658152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 546/1108] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:32 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:32.685526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e556a0-6bbb-4cfb-9090-f2d0aef2e1e8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:32.798268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e556a0-6bbb-4cfb-9090-f2d0aef2e1e8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:32.825241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:32.834439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:32.835086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:32.835318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:32.835664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:32.836828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:32.838459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416bd1-a927-4b27-b3be-cf71c6ef70aa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:32.840134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 563/1109] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:32.846221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:32.951776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5faaf-19f5-4bc1-98d0-9939961ac091 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:32.965915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:32.988578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:32.989212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:32.989494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:32.989786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:32.990451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:32.991938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02147f-525b-4915-ba1f-5fa650ba41be None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:33.016091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 547/1110] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:32:32 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:35.025654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8190f4-4e9d-4929-8045-fac798041566 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:35.026386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8190f4-4e9d-4929-8045-fac798041566 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:35.026545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8190f4-4e9d-4929-8045-fac798041566 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:35.028711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 564/1111] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:35 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:35.035547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:35.036261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:35.036413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:35.062974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:35.064201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:35.143272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 548/1112] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:35 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:35.167288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8190f4-4e9d-4929-8045-fac798041566 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:35.283007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8190f4-4e9d-4929-8045-fac798041566 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:35.323456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:35.324095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:35.324375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:35.324647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] PATH_INFO: `/v3/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:35.326134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] RBAC: Authorizing `identity:get_role(role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:35.327551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:35.328889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 565/1113] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:35 2022] GET /identity/v3/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 224 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:35.335332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:35.454697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:35.460946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a41a0-54b3-4372-a08a-0f65c0b1a7c6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:35.503060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:35.503734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:35.504015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:35.504289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] PATH_INFO: `/v3/users/e9648ef674984b479ac3b0afd7fee662` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:35.517694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] RBAC: Authorizing `identity:get_user(user_id=e9648ef674984b479ac3b0afd7fee662)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:35.519129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:35.520816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 549/1114] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:35 2022] GET /identity/v3/users/e9648ef674984b479ac3b0afd7fee662 => generated 287 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:35.527031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:35.589078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:35.632398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720d85-f6e9-4796-902e-ec7d583fdee9 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:35.668112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:35.668729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:35.669007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:35.669279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:35.759843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:35.761351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:35.824653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:35.864280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 566/1115] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:35 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 20:32:35.872273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:35.982852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0d9ca-bbe3-40f9-b3f0-b675405f63c9 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:36.016840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:36.017481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:36.017763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:36.018031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:36.019252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:36.020738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb45f4-18db-4ed5-9868-f601ac6411af None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:36.022417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 550/1116] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:35 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:36.032768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:36.138950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592370-d9bd-4dc6-9de4-fe33e9905dbd None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:36.178768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:36.179407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:36.179690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:36.179967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:36.180785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=242f794a0c654990a9a2f43a8b70f1c0, user.id=e9648ef674984b479ac3b0afd7fee662) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:36.181333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:36.182532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1dfa-8226-4f7a-baef-e6bc2ccd0cd4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:36.190081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 567/1117] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:36 2022] GET /identity/v3/role_assignments?user.id=e9648ef674984b479ac3b0afd7fee662&scope.project.id=242f794a0c654990a9a2f43a8b70f1c0&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:38.190697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f83f0-c4b4-4c93-ab0f-38fb86f394f4 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.191241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f83f0-c4b4-4c93-ab0f-38fb86f394f4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.191241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f83f0-c4b4-4c93-ab0f-38fb86f394f4 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.193302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 551/1118] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:38.200547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.200997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.201086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.221034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:38.222141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:38.246581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:38.304199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 568/1119] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:38 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:32:38.333852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f83f0-c4b4-4c93-ab0f-38fb86f394f4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:38.363209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:38.457202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f83f0-c4b4-4c93-ab0f-38fb86f394f4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:38.501502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:38.502101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.502385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.502659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] PATH_INFO: `/v3/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.504294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] RBAC: Authorizing `identity:get_role(role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:38.505722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:38.507127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 552/1120] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:38 2022] GET /identity/v3/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 224 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:38.514142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:38.635882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5524f-20e2-48b3-aecb-2412bd54e272 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:38.671572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:38.672213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.672490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.672763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] PATH_INFO: `/v3/users/e9648ef674984b479ac3b0afd7fee662` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.673950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] RBAC: Authorizing `identity:get_user(user_id=e9648ef674984b479ac3b0afd7fee662)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:38.675398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:38.677048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 569/1121] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:38 2022] GET /identity/v3/users/e9648ef674984b479ac3b0afd7fee662 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:38.684559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:38.784521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:38.794208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176290-8afa-43d0-bbfa-175e7ac11f1f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:38.830305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:38.830945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.831227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.831543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.832799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:38.834244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c31ed-0788-4898-b86d-902b1fa741fa None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:38.835969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 553/1122] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:38 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:38.842495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:38.872022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:38.947846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcfa99-9fb3-4af2-8158-05b3696467fa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:38.993131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:38.993918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:38.994199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:38.994473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0/users/e9648ef674984b479ac3b0afd7fee662/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:38.996897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] RBAC: Authorizing `identity:create_grant(project_id=242f794a0c654990a9a2f43a8b70f1c0, user_id=e9648ef674984b479ac3b0afd7fee662, role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:38.998344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd31eda-975f-4ad7-8d97-7f2a7bdaa796 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:39.014673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 570/1123] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:32:38 2022] PUT /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0/users/e9648ef674984b479ac3b0afd7fee662/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:32:40.979010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624602-c845-40db-924b-9edb559d58cf None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:40.979819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624602-c845-40db-924b-9edb559d58cf None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:40.979949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c624602-c845-40db-924b-9edb559d58cf None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:40.982033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 554/1124] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:40.990532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:40.990944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:40.991122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:41.012049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:41.013247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:41.095322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 571/1125] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:40 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:41.128031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c624602-c845-40db-924b-9edb559d58cf None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:41.242649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c624602-c845-40db-924b-9edb559d58cf None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:41.279570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:41.280201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:41.280485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:41.280760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] PATH_INFO: `/v3/roles/60f5c939ad8e41a9b2455f8c189ca593` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:41.282332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] RBAC: Authorizing `identity:get_role(role_id=60f5c939ad8e41a9b2455f8c189ca593)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:41.283737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:41.285400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 555/1126] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:41 2022] GET /identity/v3/roles/60f5c939ad8e41a9b2455f8c189ca593 => generated 224 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:41.292468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:41.320769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:41.417175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc285623-534b-402e-bd8e-525b5b742878 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:41.455661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:41.456299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:41.456578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:41.456858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] PATH_INFO: `/v3/users/e9648ef674984b479ac3b0afd7fee662` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:41.458154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] RBAC: Authorizing `identity:get_user(user_id=e9648ef674984b479ac3b0afd7fee662)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:41.459628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:41.461237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 572/1127] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:41 2022] GET /identity/v3/users/e9648ef674984b479ac3b0afd7fee662 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:41.470879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:41.504295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:41.577255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e8d37-420f-45eb-8827-647f8f6d4c39 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:41.612676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:41.613290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:41.613575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:41.613856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:41.691091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:41.692599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:41.721818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:41.798895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 556/1128] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:41 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:41.807688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:41.900915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:41.919566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16aa0-a245-402f-89e4-4b1207921d50 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:41.958962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:41.959645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:41.959923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:41.960196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] PATH_INFO: `/v3/projects/242f794a0c654990a9a2f43a8b70f1c0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:41.961509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=242f794a0c654990a9a2f43a8b70f1c0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:41.963375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7021f-5ae2-436f-a6f3-01f286e8eeb8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:41.965043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 573/1129] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:41 2022] GET /identity/v3/projects/242f794a0c654990a9a2f43a8b70f1c0 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:41.971463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:42.074075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d5615-5402-4aca-b375-bd5d6aea3a69 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:42.101077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:42.110271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:42.110881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:42.111164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:42.111464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:42.112251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] RBAC: Adding query filter params (role.id=60f5c939ad8e41a9b2455f8c189ca593, scope.project.id=242f794a0c654990a9a2f43a8b70f1c0, user.id=e9648ef674984b479ac3b0afd7fee662) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:42.112558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:42.113978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43ae53-09b2-4f72-8658-56bf5118df52 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:42.120226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 557/1130] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:41 2022] GET /identity/v3/role_assignments?user.id=e9648ef674984b479ac3b0afd7fee662&scope.project.id=242f794a0c654990a9a2f43a8b70f1c0&role.id=60f5c939ad8e41a9b2455f8c189ca593 => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:44.160617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff88f-78ef-4570-9565-dc9bbeaad57d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:44.161493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff88f-78ef-4570-9565-dc9bbeaad57d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:44.161493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ff88f-78ef-4570-9565-dc9bbeaad57d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:44.163690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 574/1131] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:44 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:44.172332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:44.172768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:44.172900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:44.196121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:44.197795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:44.287456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 558/1132] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:44 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:44.311284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ff88f-78ef-4570-9565-dc9bbeaad57d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:44.447099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ff88f-78ef-4570-9565-dc9bbeaad57d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:44.483871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:44.484500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:44.484778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:44.485053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:44.486323 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:44.487799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8beb7-6534-473b-9d41-922babd13b48 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:44.489378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 575/1133] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:44.495948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:44.596385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e035db-7a72-45db-9d55-db47c606eda8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:44.619329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:44.633273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:44.633954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:44.634235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:44.634520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:44.635221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:44.636697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daea557-7a14-4498-b5ac-d30e7a362723 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:44.665819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 559/1134] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:32:44 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:46.690215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37318f8-9950-4287-87e1-97b81da37ac0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:46.691053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37318f8-9950-4287-87e1-97b81da37ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:46.691193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37318f8-9950-4287-87e1-97b81da37ac0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:46.693403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 576/1135] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:46.700180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:46.700598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:46.700746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:46.721224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:46.722438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:46.808598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 560/1136] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:46 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:46.833055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37318f8-9950-4287-87e1-97b81da37ac0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:46.857519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:46.941862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37318f8-9950-4287-87e1-97b81da37ac0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:46.980279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:46.980943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:46.981224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:46.981494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:46.982815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:46.984321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62be9f-779d-4c4a-b0e4-840c6d176e64 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:46.985965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 577/1137] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:32:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:46.993043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:47.095606 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2ea6-9d88-4379-98ad-a227bf9d5444 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:47.097918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:47.131311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:47.131952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:47.132232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:47.132505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:47.133190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:47.134849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d3f9-4452-484d-ad93-4f2d93de5e58 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:47.162390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 561/1138] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:32:46 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:32:49.204086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb43e5-3e36-4b83-9624-409bffad039d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:49.204915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb43e5-3e36-4b83-9624-409bffad039d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:49.205098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb43e5-3e36-4b83-9624-409bffad039d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:49.207209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 578/1139] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:49.212934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:49.213385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:49.213474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:49.234234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:49.235345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:49.310462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 562/1140] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:49 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:49.334091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb43e5-3e36-4b83-9624-409bffad039d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:49.431808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:49.446966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb43e5-3e36-4b83-9624-409bffad039d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:49.482915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:49.483613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:49.483897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:49.484169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:49.495335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:49.500162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:49.501247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:49.502315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 579/1141] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:49.507865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:49.615306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:49.627972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55193-c37a-460b-8b32-15acc978d46c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:49.666653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:49.667271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:49.667599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:49.667881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:49.668608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:49.668919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:49.670316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:49.678373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 563/1142] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:49.685638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:49.807633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d18b-85bd-42fc-8127-4290c4aac6d5 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:49.843338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:49.844002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:49.844281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:49.844554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] PATH_INFO: `/v3/users/c6d7fd0a197e407fa429d205f91d7ce7` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:49.858723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] RBAC: Authorizing `identity:get_user(user_id=c6d7fd0a197e407fa429d205f91d7ce7)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:49.860205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:49.861860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 580/1143] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:49 2022] GET /identity/v3/users/c6d7fd0a197e407fa429d205f91d7ce7 => generated 287 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:49.868311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:49.975660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df9df-df9f-42a7-a289-1e9b80586c18 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:50.010760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:50.011405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:50.011676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:50.011953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:50.033690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:50.086006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:50.087424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:50.197028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 564/1144] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:49 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:50.205592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:50.216043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:50.312687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1241-3b59-4fc9-8b00-b431f2d71a8e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:50.348833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:50.349400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:50.349674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:50.349942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] PATH_INFO: `/v3/projects/918191efb1cb4062b1fc2a68b62a011b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:50.351214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] RBAC: Authorizing `identity:get_project(project_id=918191efb1cb4062b1fc2a68b62a011b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:50.352951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c92a-1cd3-4a42-bef9-a7e8d8072846 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:50.354692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 581/1145] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:50 2022] GET /identity/v3/projects/918191efb1cb4062b1fc2a68b62a011b => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:32:50.362217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:50.427513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:50.478272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e0d5-bd51-49aa-adea-33310b4498f4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:50.514444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:50.515094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:50.515397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:50.515683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:50.516492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=918191efb1cb4062b1fc2a68b62a011b, user.id=c6d7fd0a197e407fa429d205f91d7ce7) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:50.516809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:50.518245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77b725-2065-44a4-82d3-ffc1a3a3bbc0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:50.523817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 565/1146] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:50 2022] GET /identity/v3/role_assignments?user.id=c6d7fd0a197e407fa429d205f91d7ce7&scope.project.id=918191efb1cb4062b1fc2a68b62a011b&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:52.508748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73832f5-d0a3-4d4e-9023-38bf238bf43c None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:52.509361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73832f5-d0a3-4d4e-9023-38bf238bf43c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:52.509361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73832f5-d0a3-4d4e-9023-38bf238bf43c None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:52.510701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 582/1147] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:52.517169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:52.517945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:52.518046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:52.540476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:52.541684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:52.624615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 566/1148] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:52 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:52.647382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73832f5-d0a3-4d4e-9023-38bf238bf43c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:52.729041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:52.756883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73832f5-d0a3-4d4e-9023-38bf238bf43c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:52.795065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:52.795642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:52.795921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:52.796186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:52.807421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:52.813663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:52.814771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:52.815711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 583/1149] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:52.821430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:52.872214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:52.928266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7ffc3-376f-485d-803f-c1f0baa0f1fc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:52.966969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:52.967659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:52.967946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:52.968224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:52.968956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:52.969264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:52.970640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:52.979392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 567/1150] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:52.986097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:53.098483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a8a24-c98f-4b02-91a5-166ab3ef41e1 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:53.136393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:53.137037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:53.137298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:53.137577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] PATH_INFO: `/v3/users/c6d7fd0a197e407fa429d205f91d7ce7` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:53.138881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] RBAC: Authorizing `identity:get_user(user_id=c6d7fd0a197e407fa429d205f91d7ce7)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:53.140513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:53.142178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 584/1151] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:52 2022] GET /identity/v3/users/c6d7fd0a197e407fa429d205f91d7ce7 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:53.152437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:53.270716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da237f39-9c47-4d0d-ae3a-61bf05806d2f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:53.279646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:53.306713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:53.307378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:53.307672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:53.307952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] PATH_INFO: `/v3/projects/918191efb1cb4062b1fc2a68b62a011b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:53.309171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] RBAC: Authorizing `identity:get_project(project_id=918191efb1cb4062b1fc2a68b62a011b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:53.310623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3982f3-ec6b-4392-94f1-6377b59ea692 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:53.314305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 568/1152] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:53 2022] GET /identity/v3/projects/918191efb1cb4062b1fc2a68b62a011b => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:53.320723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:53.324341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:53.442657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0274-bc29-4ba5-bdf2-76af85c21719 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:53.479246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:53.479929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:53.480206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:53.480477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] PATH_INFO: `/v3/projects/918191efb1cb4062b1fc2a68b62a011b/users/c6d7fd0a197e407fa429d205f91d7ce7/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:53.482647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] RBAC: Authorizing `identity:create_grant(project_id=918191efb1cb4062b1fc2a68b62a011b, user_id=c6d7fd0a197e407fa429d205f91d7ce7, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:53.484141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd4b86-7eca-4834-a3c6-416b5202b0cb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:53.500517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 585/1153] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:32:53 2022] PUT /identity/v3/projects/918191efb1cb4062b1fc2a68b62a011b/users/c6d7fd0a197e407fa429d205f91d7ce7/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:32:55.478391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66db4a-6e1c-4d9a-ae94-11625f1562b7 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:55.478984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66db4a-6e1c-4d9a-ae94-11625f1562b7 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:55.478984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66db4a-6e1c-4d9a-ae94-11625f1562b7 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:55.480347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 569/1154] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:55.486628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:55.487316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:55.487598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:55.509220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:55.510419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:55.575798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:55.587259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 586/1155] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:55 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:55.611116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66db4a-6e1c-4d9a-ae94-11625f1562b7 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:55.726123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66db4a-6e1c-4d9a-ae94-11625f1562b7 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:55.769022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:55.769845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:55.770220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:55.770589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:55.789923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:32:55.795198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:55.796281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:32:55.797785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 570/1156] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:55.805519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:55.916823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda28c-4bcc-4b4a-96aa-c20271aa1cac None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:55.951993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:55.952616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:55.952894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:55.953184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:55.953897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:55.954206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:55.955613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:55.964359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 587/1157] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:32:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:55.971008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:56.015399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:56.092011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca580-e821-428d-a460-63037ade7d12 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:56.127633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:56.128269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:56.128557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:56.128837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] PATH_INFO: `/v3/users/c6d7fd0a197e407fa429d205f91d7ce7` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:56.130169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] RBAC: Authorizing `identity:get_user(user_id=c6d7fd0a197e407fa429d205f91d7ce7)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:56.131741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:56.133388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 571/1158] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:32:55 2022] GET /identity/v3/users/c6d7fd0a197e407fa429d205f91d7ce7 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:56.140054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:56.215131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:56.266288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c471-f855-412d-8585-7e97923953c7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:56.302291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:56.302902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:56.303184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:56.303489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:56.373021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:56.374413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:56.454503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:56.502763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 588/1159] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:56 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:56.509120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:56.613507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779200-deed-458e-9a15-881e5aefd76d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:56.615978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:56.652226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:56.652791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:56.653071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:56.653349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] PATH_INFO: `/v3/projects/918191efb1cb4062b1fc2a68b62a011b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:56.654594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] RBAC: Authorizing `identity:get_project(project_id=918191efb1cb4062b1fc2a68b62a011b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:56.656062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40b30-5e1d-4b79-8d36-eed252dd1513 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:56.657728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 572/1160] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:32:56 2022] GET /identity/v3/projects/918191efb1cb4062b1fc2a68b62a011b => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:56.668014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:56.775165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac2d3-749e-491e-ba43-cafb93e27acc None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:56.816317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:56.816940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:56.817225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:56.817498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:56.818293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=918191efb1cb4062b1fc2a68b62a011b, user.id=c6d7fd0a197e407fa429d205f91d7ce7) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:56.818606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:56.820060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4450cf-76b5-458f-ae8f-788a110dddcc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:56.826176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 589/1161] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:32:56 2022] GET /identity/v3/role_assignments?user.id=c6d7fd0a197e407fa429d205f91d7ce7&scope.project.id=918191efb1cb4062b1fc2a68b62a011b&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:32:58.825356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f619d-7a24-48de-9377-b1004829af5c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:58.825951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f619d-7a24-48de-9377-b1004829af5c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:58.825951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f619d-7a24-48de-9377-b1004829af5c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:58.827317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 573/1162] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:32:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:32:58.833844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:58.834574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:58.834715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:58.856728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:32:58.857925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:32:58.873383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:58.931465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 590/1163] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:32:58 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:32:58.954110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f619d-7a24-48de-9377-b1004829af5c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:59.081778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f619d-7a24-48de-9377-b1004829af5c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:59.118942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:59.119595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:59.119886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:59.120165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:59.163129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:59.190926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:59.192409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:59.304266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 574/1164] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:32:58 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:32:59.311804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:59.427787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9fda8-a93d-442c-94e2-efbe2d59c528 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:59.466963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:59.467627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:59.467893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:59.468165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:59.474858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:59.476338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-4a3dc1a6-62d8-40e3-90f3-53d4a0abf619 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:32:59.487782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:32:59.488903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:32:59.489785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 591/1165] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:32:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:32:59.495926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:32:59.578117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:32:59.611669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76b47a-ecb0-4741-9182-5a4ce09fa1da None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:32:59.647674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:32:59.648293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:32:59.648571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:32:59.648840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:32:59.649534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:32:59.649834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:32:59.651306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64492c-f2ae-4f76-b37d-5ebb9c73e27e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:32:59.658415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 575/1166] 10.222.0.100 () {56 vars in 1120 bytes} [Fri Aug 5 20:32:59 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:01.641518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5de49-0b52-4f58-86d9-12956a3821cc None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:01.642076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5de49-0b52-4f58-86d9-12956a3821cc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:01.642076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5de49-0b52-4f58-86d9-12956a3821cc None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:01.643424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 592/1167] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:01.649978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea72d-234e-40e6-b906-781cbf7e67f1 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:01.650798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea72d-234e-40e6-b906-781cbf7e67f1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:01.651072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea72d-234e-40e6-b906-781cbf7e67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:01.672749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6d7ea72d-234e-40e6-b906-781cbf7e67f1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:01.673951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6d7ea72d-234e-40e6-b906-781cbf7e67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:01.746160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 576/1168] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:01 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:33:01.780741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5de49-0b52-4f58-86d9-12956a3821cc None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:01.796139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:01.900853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5de49-0b52-4f58-86d9-12956a3821cc None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:01.943659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:01.944579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:01.945004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:01.945398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:01.946518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:01.948831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d551-84b0-492d-855d-ef24237b0c0b None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:01.969796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 593/1169] 10.222.0.100 () {60 vars in 1143 bytes} [Fri Aug 5 20:33:01 2022] POST /identity/v3/domains => generated 268 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:33:04.009679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064589-b82c-4bf7-8c4a-e846208a8360 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:04.010557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064589-b82c-4bf7-8c4a-e846208a8360 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:04.010557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72064589-b82c-4bf7-8c4a-e846208a8360 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:04.012770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 577/1170] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:04.018299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:04.018754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:04.018855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:04.039349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:04.040553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:04.106415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:04.115869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 594/1171] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:04 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:33:04.140482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064589-b82c-4bf7-8c4a-e846208a8360 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:04.230236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:04.279709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72064589-b82c-4bf7-8c4a-e846208a8360 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:04.318073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:04.318721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:04.318999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:04.319255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] PATH_INFO: `/v3/domains/3e486d331ba844d28ba98b2bbbfd2ae8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:04.330759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3e486d331ba844d28ba98b2bbbfd2ae8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:04.332242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ef7ee-aab5-4882-ba07-b0ebb200a857 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:04.333853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 578/1172] 10.222.0.100 () {56 vars in 1188 bytes} [Fri Aug 5 20:33:04 2022] GET /identity/v3/domains/3e486d331ba844d28ba98b2bbbfd2ae8 => generated 268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:04.343840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:04.445951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273f19-91cf-4530-b3d6-29da28243525 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:04.489538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:04.490106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:04.490386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:04.490660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:04.491399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:04.492841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942efc-eea1-4b82-b2c3-82a20f4d0f4f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:04.532801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 595/1173] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:33:04 2022] POST /identity/v3/projects => generated 362 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:33:06.549984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928d25-f437-4946-8c8c-fd62b439ec03 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:06.550591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928d25-f437-4946-8c8c-fd62b439ec03 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:06.550591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928d25-f437-4946-8c8c-fd62b439ec03 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:06.551948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 579/1174] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:06.557395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:06.557861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:06.557971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:06.588027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:06.589608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:06.639223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:06.666993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 596/1175] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:06 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:33:06.692616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928d25-f437-4946-8c8c-fd62b439ec03 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:06.804458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928d25-f437-4946-8c8c-fd62b439ec03 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:06.835636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:06.847103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:06.847803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:06.848089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:06.848395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] PATH_INFO: `/v3/domains/3e486d331ba844d28ba98b2bbbfd2ae8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:06.849588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=3e486d331ba844d28ba98b2bbbfd2ae8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:06.851046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e55cf8-67e7-4c61-8774-59b4a4dec7be None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:06.852713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 580/1176] 10.222.0.100 () {56 vars in 1188 bytes} [Fri Aug 5 20:33:06 2022] GET /identity/v3/domains/3e486d331ba844d28ba98b2bbbfd2ae8 => generated 268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:06.858962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:06.968056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d489a60-6e50-4e94-a6a2-4172bef40d39 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:07.006026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780009-8236-49da-ae51-685186d6af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:07.006667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780009-8236-49da-ae51-685186d6af22 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:07.006949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780009-8236-49da-ae51-685186d6af22 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:07.007228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780009-8236-49da-ae51-685186d6af22 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:07.007956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83780009-8236-49da-ae51-685186d6af22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:07.009421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83780009-8236-49da-ae51-685186d6af22 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:07.035076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 597/1177] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:33:06 2022] POST /identity/v3/users => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:33:09.077980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d758-64a8-4eb3-a222-a5a48f13cafb None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.078544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d758-64a8-4eb3-a222-a5a48f13cafb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.078544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d758-64a8-4eb3-a222-a5a48f13cafb None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.080686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 581/1178] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:09.088792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.089254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.089352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.109922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:09.111135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:09.143701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:09.190579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 598/1179] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:09 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:33:09.214184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d758-64a8-4eb3-a222-a5a48f13cafb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:09.326039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d758-64a8-4eb3-a222-a5a48f13cafb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:09.361244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:09.361883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.362167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.362448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.373845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:33:09.378727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:33:09.379881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:33:09.381139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 582/1180] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:33:09.386539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:09.493359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85449ad-f97c-49e1-83ac-d2da125874a3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:09.529036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:09.529660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.529942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.530215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.530948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:33:09.531257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:09.532686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:09.541160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 599/1181] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:33:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:33:09.548239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:09.608025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:09.659166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10da22-8c5a-4224-82a0-002ad22db9d0 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:09.692657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:09.693299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.693596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.693838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] PATH_INFO: `/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.707457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] RBAC: Authorizing `identity:get_user(user_id=bb0e0be8cdf34014b4f8937fc1a4de0d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:09.709015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:09.710672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 583/1182] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:33:09 2022] GET /identity/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:09.720722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:09.759828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:09.846100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920822a9-5b57-41ea-889b-252b8de1389f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:09.882116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:09.882737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:09.883021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:09.883296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:09.953552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:09.955008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:09.982541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:10.055040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 600/1183] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:33:09 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:33:10.062221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:10.171787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454f9b-b7d3-4731-b27f-0bb78dd4bc3d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:10.186504 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:10.218764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:10.219466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:10.219714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:10.220009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] PATH_INFO: `/v3/projects/1cf8d5f1f050405993c1b6caa4405345` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:10.221253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] RBAC: Authorizing `identity:get_project(project_id=1cf8d5f1f050405993c1b6caa4405345)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:10.222713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc70db-9199-4e8a-9223-d81ed34e633a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:10.224437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 584/1184] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:33:10 2022] GET /identity/v3/projects/1cf8d5f1f050405993c1b6caa4405345 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:10.230950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:10.337697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f93b4-0497-411c-9c83-224f5bb42aab None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:10.365628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:10.377075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:10.377948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:10.378303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:10.378658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:10.379909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=1cf8d5f1f050405993c1b6caa4405345, user.id=bb0e0be8cdf34014b4f8937fc1a4de0d) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:33:10.380332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:10.382591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73d58-bbbe-48af-8f31-58a55491a9b3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:10.391401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 601/1185] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:33:10 2022] GET /identity/v3/role_assignments?user.id=bb0e0be8cdf34014b4f8937fc1a4de0d&scope.project.id=1cf8d5f1f050405993c1b6caa4405345&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:33:12.431478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6db1-116a-4d80-9c20-06e6da3d4927 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:12.432013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6db1-116a-4d80-9c20-06e6da3d4927 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:12.432013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6db1-116a-4d80-9c20-06e6da3d4927 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:12.434045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 585/1186] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:12.442770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:12.443163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:12.443480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:12.465288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:12.466482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:12.544105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 602/1187] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:12 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:33:12.566680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6db1-116a-4d80-9c20-06e6da3d4927 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:12.679651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6db1-116a-4d80-9c20-06e6da3d4927 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:12.721044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:12.721991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:12.722389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:12.722778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:12.737809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:33:12.742657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:33:12.743744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:33:12.748431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 586/1188] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:33:12.750088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:12.861101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6724-1bfa-44b7-b0a6-d53c8ed61e48 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:12.884966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:12.902550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:12.903200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:12.903492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:12.903760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:12.904486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:33:12.904784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:12.906164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:12.914952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 603/1189] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:33:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:12.923932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:12.972762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:13.032778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1559-1d28-4e61-8ba7-527655b7536a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:13.068620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:13.069261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:13.069541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:13.069817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] PATH_INFO: `/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:13.071107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] RBAC: Authorizing `identity:get_user(user_id=bb0e0be8cdf34014b4f8937fc1a4de0d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:13.072617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:13.074208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 587/1190] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:33:12 2022] GET /identity/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:13.081049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:13.201784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bdcb-82a6-414c-bd89-0fba2e215fe7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:13.240594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:13.241155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:13.241429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:13.241701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] PATH_INFO: `/v3/projects/1cf8d5f1f050405993c1b6caa4405345` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:13.242963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] RBAC: Authorizing `identity:get_project(project_id=1cf8d5f1f050405993c1b6caa4405345)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:13.244464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf4f2-257e-47fd-b78a-dd248944712d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:13.246118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 604/1191] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:33:13 2022] GET /identity/v3/projects/1cf8d5f1f050405993c1b6caa4405345 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:13.255845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:13.375412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3dc07-eca1-41d8-b9bf-027376bf6314 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:13.384766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:13.413573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:13.414236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:13.414518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:13.414799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] PATH_INFO: `/v3/projects/1cf8d5f1f050405993c1b6caa4405345/users/bb0e0be8cdf34014b4f8937fc1a4de0d/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:13.417069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf8d5f1f050405993c1b6caa4405345, user_id=bb0e0be8cdf34014b4f8937fc1a4de0d, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:13.418551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb7bba-7321-4a03-ab64-671c60076ec5 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:13.434303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 588/1192] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:33:13 2022] PUT /identity/v3/projects/1cf8d5f1f050405993c1b6caa4405345/users/bb0e0be8cdf34014b4f8937fc1a4de0d/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:33:15.405538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301791b0-7280-443a-8b99-1d13ea07476d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:15.406310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301791b0-7280-443a-8b99-1d13ea07476d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:15.406310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301791b0-7280-443a-8b99-1d13ea07476d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:15.408521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 605/1193] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:33:15 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:33:15.416800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:15.417257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:15.417361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:15.435820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:33:15.437017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:33:15.509757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 589/1194] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:33:15 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:33:15.533699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301791b0-7280-443a-8b99-1d13ea07476d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:15.592562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:15.647129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301791b0-7280-443a-8b99-1d13ea07476d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:15.683987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:15.684566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:15.684845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:15.685113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:15.697988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:33:15.702801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:33:15.703955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:33:15.704986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 606/1195] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:33:15.710833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:15.817730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:15.822279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bee9d9-8268-4062-bf81-0e8cde56b186 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:15.858666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:15.859287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:15.859605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:15.859885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:15.860605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:33:15.860910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:15.862295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:15.870527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 590/1196] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:33:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:33:15.880089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:15.995397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0ad1-3489-40f2-b253-22cd7391c570 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:16.009008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:16.033030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:16.033679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:16.033955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:16.034238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] PATH_INFO: `/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:16.035938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb0e0be8cdf34014b4f8937fc1a4de0d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:16.037387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:16.039004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 607/1197] 10.222.0.100 () {56 vars in 1182 bytes} [Fri Aug 5 20:33:15 2022] GET /identity/v3/users/bb0e0be8cdf34014b4f8937fc1a4de0d => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:16.045561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:16.156930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672289a1-ad4a-4068-afe4-5360df357c0c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:16.204101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:16.204734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:16.205019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:16.205299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:16.233972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:16.273816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:16.275285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:16.392736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 591/1198] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:33:16 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:33:16.402426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:16.522036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454212de-5fc0-48ab-8d43-9ac60258eae3 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:16.557680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:16.558361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:16.558644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:16.558923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] PATH_INFO: `/v3/projects/1cf8d5f1f050405993c1b6caa4405345` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:16.560248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf8d5f1f050405993c1b6caa4405345)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:16.561707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd9002-cc70-45d6-be3b-64b81e58fb80 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:16.563388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 608/1199] 10.222.0.100 () {56 vars in 1191 bytes} [Fri Aug 5 20:33:16 2022] GET /identity/v3/projects/1cf8d5f1f050405993c1b6caa4405345 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:16.570473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:33:16.641195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:16.690599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81366be-c247-4ba3-a800-3d5f7f58457f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:33:16.726576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:33:16.727207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:33:16.727520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:33:16.727800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:33:16.728605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=1cf8d5f1f050405993c1b6caa4405345, user.id=bb0e0be8cdf34014b4f8937fc1a4de0d) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:33:16.728945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:33:16.730388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677350b-b5d3-4668-806c-5c96e6fbd85b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:33:16.736403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 592/1200] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:33:16 2022] GET /identity/v3/role_assignments?user.id=bb0e0be8cdf34014b4f8937fc1a4de0d&scope.project.id=1cf8d5f1f050405993c1b6caa4405345&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:33:26.552487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=76 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:33:26.733867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=38 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:11.989660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a251c4d-3d1c-4b5e-9fca-5c201aa621ce None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:11.990293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a251c4d-3d1c-4b5e-9fca-5c201aa621ce None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:11.990293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a251c4d-3d1c-4b5e-9fca-5c201aa621ce None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:11.991971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 609/1201] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:11.997881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:11.998432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:11.998526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:12.018887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:12.020678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:12.113639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 593/1202] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:11 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:12.140228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a251c4d-3d1c-4b5e-9fca-5c201aa621ce None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:12.268735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a251c4d-3d1c-4b5e-9fca-5c201aa621ce None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:12.312579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:12.313358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:12.313642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:12.313913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:12.329641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:12.331330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:12.350976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:12.352483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:12.353848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:12.353848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:12.353848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:12.353848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:12.353848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 610/1203] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:12.358918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:12.488760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd527b-bba9-450a-bd0c-f5116e33c58c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:12.526029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:12.535830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:12.536940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:12.537429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:12.538125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:12.538534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:12.538860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:12.540600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121df82b-1483-4ffd-98b0-7d33b20b26e6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:12.556627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 594/1204] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:12.563606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:12.636014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:12.711043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662350-e429-4a0f-9349-a80357aa0273 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:12.764614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:12.765765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:12.766409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:12.766785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:12.767699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:12.769219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda8957-afbe-42b2-bca4-8d27b7c713e1 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:12.801033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 611/1205] 10.222.0.100 () {60 vars in 1137 bytes} [Fri Aug 5 20:34:12 2022] POST /identity/v3/users => generated 252 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:34:15.133341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587273-b52f-4331-88b5-364de1d9fdc2 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:15.133933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587273-b52f-4331-88b5-364de1d9fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:15.133933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587273-b52f-4331-88b5-364de1d9fdc2 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:15.135402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 595/1206] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:15.141197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:15.141679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:15.141803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:15.163564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:15.164797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:15.243331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 612/1207] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:15 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 20:34:15.268399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587273-b52f-4331-88b5-364de1d9fdc2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:15.394743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587273-b52f-4331-88b5-364de1d9fdc2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:15.432407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:15.433149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:15.433435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:15.433710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:15.444811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:15.450093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:15.451287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:15.452326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 596/1208] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:15.459012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:15.507048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:15.575551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a502-14a1-42bb-8adf-cd0fa473de03 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:15.615604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:15.616228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:15.616530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:15.616768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:15.617814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:15.617814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:15.620834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:15.629930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 613/1209] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:34:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:15.635946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:15.700610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:15.761697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05509d-ef20-4ac1-85a8-5f09a45a5cdd None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:15.811493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:15.812378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:15.812772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:15.813192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:15.826896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:15.828334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:15.844513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:15.845774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:15.846705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:15.846705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:15.846705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:15.846705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:15.846705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 597/1210] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:15.851835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:15.969135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:15.971333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d184bc-b75e-412c-9467-8941e932ec4a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:16.013333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:16.013890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:16.014176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:16.014448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:16.015277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:16.015668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:16.017265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:16.032104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 614/1211] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:16.038424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:16.165082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd7234-ca7f-4963-8ef4-38418231faac None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:16.167190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:16.206092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:16.206897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:16.207186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:16.207585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:16.217112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:16.218806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:16.232220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:16.233398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:16.234398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 598/1212] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:16.243169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:16.381374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c970-e31c-4a54-9491-845e04ebf83d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:16.427560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:16.428263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:16.428571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:16.428856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:16.429772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:16.430121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:16.432587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:16.453315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 615/1213] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:16.459386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:16.591397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964c82-5fe7-4216-a55d-c3bb8f32200b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:16.635792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:16.636526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:16.636843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:16.637180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:16.676463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:16.724187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:16.726231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:16.858422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 599/1214] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:34:16 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:34:16.864421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:16.886975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:16.992003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af217fe-0005-4c37-8eb6-d11f843bff49 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:17.034829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:17.035673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:17.035995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:17.036404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:17.048804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:17.050405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:17.071235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:17.072437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:17.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:17.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:17.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:17.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:17.073843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 616/1215] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:17.078861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:17.154276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:17.208934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f166-0b05-4c39-be6a-af1194a1e2a6 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:17.254186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:17.254924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:17.255230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:17.255573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:17.256464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:17.256869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:17.258626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:17.274885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 600/1216] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:17.281601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:17.382753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:17.422975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3c5c-f9cf-46b4-b307-12a6e698404f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:17.460947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:17.461595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:17.461874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:17.462152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:17.469952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:17.471471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:17.484461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:17.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:17.486403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 617/1217] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:17.491567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:17.608734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd7f1-e4e2-4944-a478-d1407520a879 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:17.637166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:17.652996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:17.653676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:17.654017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:17.654279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:17.655153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:17.655560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:17.657206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30431-9e26-42d6-b8f8-79ac62138509 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:17.672494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 601/1218] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:17.678783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:17.797298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404417-5a0d-400b-a051-eac2bd11fb75 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:17.832022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:17.841595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:17.842272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:17.842595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:17.842934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:17.843915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=93ed5ec5662f4ca383b4c2e1653d150f) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:17.844287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:17.846060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222d9a9-5d8e-4ae1-a171-331f7e5022a8 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:17.852901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 618/1219] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:34:17 2022] GET /identity/v3/role_assignments?user.id=93ed5ec5662f4ca383b4c2e1653d150f&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:19.882570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96f460-6200-4318-9233-a66979153129 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:19.883208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96f460-6200-4318-9233-a66979153129 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:19.883208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96f460-6200-4318-9233-a66979153129 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:19.884779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 602/1220] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:19.891828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:19.892347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:19.892441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:19.917685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:19.918891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:20.002364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 619/1221] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:19 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:20.026241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96f460-6200-4318-9233-a66979153129 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.136487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96f460-6200-4318-9233-a66979153129 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:20.176588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:20.177280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:20.177564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:20.177836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:20.190375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:20.196387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:20.197719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:20.198837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 603/1222] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:20.204464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.321649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2e66-b56e-4b37-ad4f-d73d08bfcf9c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:20.348701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:20.362456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:20.363200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:20.363616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:20.363982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:20.364964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:20.365376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:20.367222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:20.384682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 620/1223] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:20.386901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.445695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:20.514275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90d65c-76f9-40cb-a9bf-55db8b58c515 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:20.555544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:20.556199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:20.556513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:20.556797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:20.568222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:20.569682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:20.584943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:20.586050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:20.587168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:20.587168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:20.587168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:20.587168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:20.587168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 604/1224] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:20.592191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.707527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476a89-487a-42f0-983d-6af59b327b86 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:20.745348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:20.745982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:20.746266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:20.746542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:20.747249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:20.747600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:20.748989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:20.761278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 621/1225] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:20.767350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.870910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:20.877831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491778ce-46d2-4a38-900f-1d715a39420c None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:20.914533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:20.915204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:20.915572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:20.915950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:20.923964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:20.925634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:20.937448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:20.938640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:20.939642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 605/1226] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:20.944752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:20.996252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:21.051687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54edb55-a2bc-4192-9494-ca3fb4c602e0 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.088197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.088574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.088856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.089172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:21.090072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:21.090384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:21.092029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:21.110520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 622/1227] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:21.116352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:21.225107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919f1c-e0a0-4de2-95cb-fdc427ca8aac None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.259877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.260540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.260823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.261100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:21.272620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:21.274174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:21.290418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:21.296825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:21.297856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:21.297856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:21.297856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:21.297856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:21.297856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 606/1228] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:21.298155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:21.401523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b75d-2354-4b4e-b49b-b8d9376af23f None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.404092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:21.437578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.438200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.438495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.438763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:21.439541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:21.439827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:21.441228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:21.453231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 623/1229] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:21.459143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:21.468949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:21.574787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc1c4-a7ae-40ac-9f1a-83383a7cf14d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.620706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.621415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.621666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.621944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:21.629934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:21.631566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:21.644896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:21.645891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:21.646835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 607/1230] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:21.652427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:21.763835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7a8af-f78c-4e01-a6c7-eee7833f7abe None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.804043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.804767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.805095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.805394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:21.806154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:21.806482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:21.807973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647436-07ce-4533-84c0-31f40ca3ff9e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:21.821701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 624/1231] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:21.830186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:21.907226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:21.948911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3cb0-3512-4c1c-b226-aefdd4b503a2 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:21.985736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:21.986386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:21.986663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:21.986936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/93ed5ec5662f4ca383b4c2e1653d150f/roles/bc03df287bb24fd2966cde68a6bdc46b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:22.003284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=93ed5ec5662f4ca383b4c2e1653d150f, role_id=bc03df287bb24fd2966cde68a6bdc46b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:22.005168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78666-1817-4b5b-aab4-23d1d6b5c7e8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:22.019940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 608/1232] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:34:21 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/93ed5ec5662f4ca383b4c2e1653d150f/roles/bc03df287bb24fd2966cde68a6bdc46b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:34:24.032522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288047-b65d-40c2-b3df-5ef8d393ead0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.033046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288047-b65d-40c2-b3df-5ef8d393ead0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.033166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56288047-b65d-40c2-b3df-5ef8d393ead0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.034813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 625/1233] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:24.040174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.040597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.040835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.059498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:24.060714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:24.139386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 609/1234] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:24 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:24.159569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288047-b65d-40c2-b3df-5ef8d393ead0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:24.187420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:24.279153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56288047-b65d-40c2-b3df-5ef8d393ead0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:24.318176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:24.318890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.319202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.319672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.332906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:24.339030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:24.340208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:24.341264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 626/1235] 10.222.0.100 () {56 vars in 1107 bytes} [Fri Aug 5 20:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:24.351470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:24.404343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:24.467622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad123be-1955-40c6-928c-0adb758b10cb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:24.505396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:24.506115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.506419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.506704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.507516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] RBAC: Adding query filter params (name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:24.507827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:24.509235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:24.517907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 610/1236] 10.222.0.100 () {56 vars in 1108 bytes} [Fri Aug 5 20:34:24 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:24.524005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:24.616939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:24.634011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe21e-55e6-40b4-a43d-a2051b8067f4 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:24.672862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:24.673996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.674502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.674999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.691516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:24.693243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:24.712010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:24.713359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:24.714297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:24.714297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:24.714297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:24.714297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:24.714297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 627/1237] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:24.719446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:24.829182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fe3a-8512-4f3e-89ac-539304b3150f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:24.839195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:24.865367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:24.865990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:24.866269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:24.866540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:24.867287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:24.867602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:24.869603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:24.881505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 611/1238] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:24.887624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:25.003161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1e86-9bf5-4f85-b04f-d0ca2599a399 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:25.039107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:25.039819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:25.040075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:25.040340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:25.043260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:25.048804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:25.050276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:25.062131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:25.063349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:25.064319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 628/1239] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:25.069616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:25.174792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ad9b-ab60-458d-bcc6-e57b7c610a72 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:25.212061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:25.212968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:25.213536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:25.213661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:25.214414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:25.214723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:25.216200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:25.233932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 612/1240] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:25.240223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:25.351993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8b9b-5fd7-410b-a662-1621fe1de8fa None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:25.391655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:25.392644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:25.393066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:25.393408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:25.465301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:25.473982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:25.475482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:25.581191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 629/1241] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:34:25 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:34:25.587230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:25.615314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:25.693352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a6a7-c320-401a-b1f9-018ca6278113 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:25.729631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:25.730269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:25.730559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:25.730844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:25.741601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:25.743057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:25.757818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:25.758908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:25.760512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:25.760512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:25.760512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:25.760512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:25.760512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 613/1242] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:25.765058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:25.870467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:25.878518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aca73b-b96e-4123-b0cf-f6c18a81f25e None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:25.921399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:25.922167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:25.922451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:25.922730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:25.923468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:25.923776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:25.925313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:25.940041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 630/1243] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:25.946060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:26.029319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:26.051569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cb7e-7cdd-4f3e-a28b-fdf695372182 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:26.085783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:26.086461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:26.086696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:26.086967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:26.093953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:26.095416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:26.108452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:26.109466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:26.110567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:26.112371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 614/1244] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:26.118622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:26.232157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c115-8327-4ea6-a761-c5250e7a19bb None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:26.270587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:26.271227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:26.271593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:26.271846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:26.272682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:26.272935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:26.274364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec2b9-adac-45e5-b9b6-b198f5668135 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:26.288512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 631/1245] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:26.295040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:26.420259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780d0e1-2bb6-4f93-a26e-44372f3db4ce None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:26.456552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:26.457212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:26.457624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:26.457934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:26.458732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] RBAC: Adding query filter params (role.id=bc03df287bb24fd2966cde68a6bdc46b, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=93ed5ec5662f4ca383b4c2e1653d150f) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:26.459050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:26.460692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bae90-44f7-41f3-beb6-a1510cac48b0 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:26.467829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 615/1246] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:34:26 2022] GET /identity/v3/role_assignments?user.id=93ed5ec5662f4ca383b4c2e1653d150f&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=bc03df287bb24fd2966cde68a6bdc46b => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:28.556412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511f27-8b13-4b8c-b79b-80c469f68e0a None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:28.557025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511f27-8b13-4b8c-b79b-80c469f68e0a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:28.557269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511f27-8b13-4b8c-b79b-80c469f68e0a None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:28.558788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 632/1247] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:34:28.564273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:28.564764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:28.564871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:28.571403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:28.584415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:28.585637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:28.666127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 616/1248] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:28 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:28.690931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511f27-8b13-4b8c-b79b-80c469f68e0a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:28.714440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:28.813392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511f27-8b13-4b8c-b79b-80c469f68e0a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:28.851212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:28.851908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:28.852193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:28.852468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:28.863302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:28.868279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:28.870110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:28.870989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 633/1249] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:28.875789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:28.996516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010183-bf1e-4b38-a5d5-57e81f841e68 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.032460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:29.038358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.038990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.039272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.039588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:29.040304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:29.040743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:29.042373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:29.051796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 617/1250] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:34:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:29.058364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:29.142785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:29.166895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74e47-4086-4c6c-a0cc-0b3c1b312c63 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.210402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.211044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.211336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.211661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:29.224086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:29.225530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:29.242441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:29.243722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:29.245442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:29.245442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:29.245442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:29.245442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:29.245442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 634/1251] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:29.250362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:29.357449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f8bf-7d1f-4b54-9c70-ae712d72a4d8 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.396438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.396889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.397170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.397444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:29.398135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:29.398442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:29.400006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:29.413113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 618/1252] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:29.419146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:29.536728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1133a-5849-46b1-88c8-019ff3c6400a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.564669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:29.573008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.573665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.573948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.574221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:29.584159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:29.585901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:29.599403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:29.600585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:29.601722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 635/1253] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:29.606994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:29.670063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:29.725927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c484a-aa98-4648-909b-5bd4dd250e8b None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.762571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.763217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.763538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.763817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:29.764625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:29.764982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:29.766539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:29.787220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 619/1254] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:29.793421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:29.905570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a635-3d23-49a4-b634-44b995317d02 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:29.948190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:29.948831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:29.949117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:29.949394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:30.018243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:30.032609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:30.034402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:30.142936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 636/1255] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:34:29 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:34:30.148984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:30.257914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4bfe-4a77-4f66-866b-a9b559061e03 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:30.271676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:30.295049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:30.295770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:30.296076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:30.296362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:30.307688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:30.309241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:30.326330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:30.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:30.328300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:30.328300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:30.328300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:30.328300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:30.328300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 620/1256] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:30.333975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:30.434936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:30.449719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17552c3-1651-43e5-bdd7-d615c708c087 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:30.490496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:30.491272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:30.491584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:30.491942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:30.492799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:30.493156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:30.494625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:30.513351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 637/1257] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:30.514594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:30.634716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd62d8-fdf7-4239-a5b1-4f58b30a0e47 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:30.673156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:30.673964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:30.674400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:30.674774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:30.682917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:30.684424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:30.697318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:30.698435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:30.699498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 621/1258] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:30.706356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:30.825586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fd85-b6b7-4ad8-a3e4-42418d344fc2 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:30.865046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:30.865646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:30.865924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:30.866199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:30.866952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:30.867262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:30.868738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14a9a-1347-409b-869b-244e4f9608cc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:30.881340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 638/1259] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:30.888031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:30.917992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:31.003587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e517da-4c2b-4b2d-8c7b-bed602db78ad None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:31.055957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:31.056968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:31.057443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:31.057912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:31.059387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=93ed5ec5662f4ca383b4c2e1653d150f) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:31.059904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:31.062524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9584e-53ff-442f-b47f-b13fc04f3cc2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:31.070907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 622/1260] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:34:30 2022] GET /identity/v3/role_assignments?user.id=93ed5ec5662f4ca383b4c2e1653d150f&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:33.050312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066212-4d48-4fcd-aa38-104752194308 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.050876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066212-4d48-4fcd-aa38-104752194308 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.051031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066212-4d48-4fcd-aa38-104752194308 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.052579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 639/1261] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:33.059530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.060033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.060121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.081260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:33.082614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:33.156261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 623/1262] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:33 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:33.178921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066212-4d48-4fcd-aa38-104752194308 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:33.190189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:33.283093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066212-4d48-4fcd-aa38-104752194308 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:33.317864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:33.318505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.318776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.319046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.329274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:33.334153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:33.335229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:33.336425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 640/1263] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:33.341527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:33.361570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:33.453225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3525-5d42-4d0d-8aeb-64eebe45e1d9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:33.491959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:33.492584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.492860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.493131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.493901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:33.494202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:33.495587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:33.504679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 624/1264] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:34:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:33.511496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:33.588583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:33.623986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59dee3-399c-4002-95f9-792eb966c7fe None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:33.660709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:33.661583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.661983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.662270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.677449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:33.679566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:33.698218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:33.699597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:33.700659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:33.700659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:33.700659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:33.700659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:33.700659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 641/1265] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:33.705571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:33.798529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:33.826311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f730-3dcc-4eac-b9d3-26e0a3f17540 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:33.861804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:33.862346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:33.862629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:33.862901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:33.863602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:33.863936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:33.865308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:33.877398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 625/1266] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:33.883899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:33.996373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e9a0b-24eb-4ada-9440-88071f2c7dbc None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.017716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:34.033748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.034390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.034671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.034940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.042666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.044148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:34.055387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:34.057163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:34.058219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 642/1267] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:34.063638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:34.168391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7d06-1d27-4e76-a0b0-d71b229ef99d None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.203220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.203862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.204145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.204439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.205216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:34.205529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.206964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.215890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:34.224785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 626/1268] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:34.234248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:34.350241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b30f5-0d43-49a9-960b-1bedad1934fc None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.400266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.401049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.401328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.401601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.413573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.415024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:34.430445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:34.431539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:34.432689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:34.432689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:34.432689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:34.432689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:34.432689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 643/1269] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:34.438485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:34.551614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fcf7b-eb04-4389-9d67-1cd49c35eed7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.597048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.597664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.597949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.598225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.598929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:34.599236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.600639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.612361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 627/1270] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:34.620709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:34.653823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:34.729264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ebce5-ca25-4202-aa4f-619919f08194 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.764572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.765202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.765491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.765762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.772859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.774307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:34.786783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:34.787859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:34.789523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 644/1271] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:34.794877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:34.854596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:34.901080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a00a1-b6a1-4498-8979-5b80fe1cb5cc None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:34.942598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:34.943231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:34.943544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:34.943820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:34.944577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:34.944885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:34.946377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df203b-353c-47bf-a318-f9f415e57105 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:34.960259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 628/1272] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:34.966778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:35.070415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:35.079933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122e0ac-7b86-44ea-999b-a1c9c147b523 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:35.116438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:35.117104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:35.117382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:35.117654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] PATH_INFO: `/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/93ed5ec5662f4ca383b4c2e1653d150f/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:35.119840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0b50b4e5b3646fe9cae583b51f6fb94, user_id=93ed5ec5662f4ca383b4c2e1653d150f, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:35.121275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db7b25-fa11-4fbd-bbc1-a094f9326506 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:35.140012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 645/1273] 10.222.0.100 () {58 vars in 1444 bytes} [Fri Aug 5 20:34:34 2022] PUT /identity/v3/projects/b0b50b4e5b3646fe9cae583b51f6fb94/users/93ed5ec5662f4ca383b4c2e1653d150f/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:34:37.105807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b53-21b3-48b1-b732-5e2cee1d83ba None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.106723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b53-21b3-48b1-b732-5e2cee1d83ba None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.106723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b53-21b3-48b1-b732-5e2cee1d83ba None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.108834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 629/1274] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:37.114299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.114748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.114857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.135253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:37.136474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:37.212639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 646/1275] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:37 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:37.236312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51352b53-21b3-48b1-b732-5e2cee1d83ba None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:37.343560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51352b53-21b3-48b1-b732-5e2cee1d83ba None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:37.362563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:37.383391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:37.384295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.384909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.385189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.397061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 20:34:37.402595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:37.403764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:37.405069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 630/1276] 10.222.0.100 () {56 vars in 1101 bytes} [Fri Aug 5 20:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:37.413124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:37.503554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:37.524090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034501-6363-47ad-aa62-53b6c138ca6f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:37.559327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:37.559961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.560262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.560538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.561271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:37.561578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:37.562972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:37.571034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 647/1277] 10.222.0.100 () {56 vars in 1104 bytes} [Fri Aug 5 20:34:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:37.577966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:37.706907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2a011-b7fd-4949-9f60-397cf61ee64f None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:37.748943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:37.750031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.750450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.750868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.766102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:37.767563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:37.782473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:37.784102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:37.785160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:37.785160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:37.785160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:37.785160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:37.785160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 631/1278] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:37.790090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:37.896399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06da18-d772-4ec8-8c24-f559e8155d7d None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:37.931623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:37.932237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:37.932515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:37.932799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:37.933497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:37.933805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:37.935194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:37.947073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 648/1279] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:37.953156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:37.996420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:38.067735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0e17-de9a-4a96-aa5e-8324e0ee5982 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:38.102976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f685c-78df-4145-9714-714830e74311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:38.103786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f685c-78df-4145-9714-714830e74311 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:38.104074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f685c-78df-4145-9714-714830e74311 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:38.104353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f685c-78df-4145-9714-714830e74311 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:38.111982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f685c-78df-4145-9714-714830e74311 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:38.113437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f685c-78df-4145-9714-714830e74311 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-318f685c-78df-4145-9714-714830e74311 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 20:34:38.125001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:38.126038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:38.127496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 632/1280] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 20:34:38.133899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:38.137781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:38.234212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ecb8-71f2-4c87-bbee-d283eac606a7 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:38.269367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:38.269981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:38.270259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:38.270533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:38.271329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:38.271668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:38.273106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:38.291606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 649/1281] 10.222.0.100 () {56 vars in 1148 bytes} [Fri Aug 5 20:34:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:38.297896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f685c-78df-4145-9714-714830e74311 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:38.392701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:38.403002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f685c-78df-4145-9714-714830e74311 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:38.438038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:38.438669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:38.438952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:38.439231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:38.518020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:38.519521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:38.618525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:38.630071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 633/1282] 10.222.0.100 () {58 vars in 1287 bytes} [Fri Aug 5 20:34:38 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 20:34:38.636669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:38.712901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:38.754456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad91b9-77e8-475a-9ed4-f5551048e461 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:38.793376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:38.794012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:38.794294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:38.794618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:38.806148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:38.807666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 20:34:38.823722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:38.824726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:38.826222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 20:34:38.826222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 20:34:38.826222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 20:34:38.826222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:38.826222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 650/1283] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:38.834332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:38.957780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566a83c-ee36-4982-bd22-2374619f427a None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:39.005092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:39.005735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:39.006041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:39.006318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:39.007002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:39.007311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:39.008770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:39.021538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 634/1284] 10.222.0.100 () {56 vars in 1114 bytes} [Fri Aug 5 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:39.027919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:39.139417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675b84-8d0c-4a8a-b141-2a9fd7af1d4a None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:39.154847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:39.180136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:39.180815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:39.181378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:39.181378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:39.188333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:39.189814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 20:34:39.201627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:39.202666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: ERROR keystone.server.flask.application Aug 05 20:34:39.203766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 651/1285] 10.222.0.100 () {56 vars in 1116 bytes} [Fri Aug 5 20:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:39.210794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:39.268860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:39.325523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d6a4a-d8ae-446e-b19f-a1290eed2ab7 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:39.361376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:39.362002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:39.362275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:39.362549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:39.363308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:39.363659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:39.365103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f659a1-e8d5-418b-ad75-11335088bf64 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:39.377599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 635/1286] 10.222.0.100 () {56 vars in 1153 bytes} [Fri Aug 5 20:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:39.384848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:39.509108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb4f3-3b9d-424a-8fd0-4b9d24705b09 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:39.544172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:39.544715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:39.544999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:39.545269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:39.546057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] RBAC: Adding query filter params (role.id=e5925905b2aa4220ba3cded1ac5f08ba, scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94, user.id=93ed5ec5662f4ca383b4c2e1653d150f) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:39.546369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:39.547834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a029c-8378-4602-b4c6-1ab334072772 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:39.553766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 652/1287] 10.222.0.100 () {56 vars in 1379 bytes} [Fri Aug 5 20:34:39 2022] GET /identity/v3/role_assignments?user.id=93ed5ec5662f4ca383b4c2e1653d150f&scope.project.id=b0b50b4e5b3646fe9cae583b51f6fb94&role.id=e5925905b2aa4220ba3cded1ac5f08ba => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:41.539286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1da-0a90-4971-ad6c-937df5a4b384 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:41.539905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1da-0a90-4971-ad6c-937df5a4b384 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:41.539905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add1da-0a90-4971-ad6c-937df5a4b384 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:41.541327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 636/1288] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:41.547725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:41.548446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:41.548588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:41.577073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:41.578289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:41.612898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:41.659203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 653/1289] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:41 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:41.683906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add1da-0a90-4971-ad6c-937df5a4b384 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:41.801247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add1da-0a90-4971-ad6c-937df5a4b384 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:41.812405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:41.836188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:41.836809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:41.837180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:41.837450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:41.838072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:41.839571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:41.848982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:41.850159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:41.851378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 637/1290] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:34:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:41.857097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:41.964872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913fb2-d9f7-4b7e-9c2b-2f08e46117c9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:42.006337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:42.007291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:42.007789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:42.008198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:42.009379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:42.009876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:42.012162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020512-88b3-486c-a0f0-b01152d642fb None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:42.020574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 654/1291] 10.222.0.100 () {56 vars in 1121 bytes} [Fri Aug 5 20:34:41 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:42.028796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:42.157938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5466-6efe-4dbd-b466-0cd4724e982e None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:42.194183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:42.194815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:42.195094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:42.195402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] PATH_INFO: `/v3/services` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:42.196087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:42.196462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:42.197849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ed2a5-2958-4cc1-a74e-88655a80cef2 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:42.202527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 638/1292] 10.222.0.100 () {56 vars in 1121 bytes} [Fri Aug 5 20:34:42 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:44.182766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1d6f-5710-430c-9ef4-1c133a2110cd None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:44.183666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1d6f-5710-430c-9ef4-1c133a2110cd None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:44.183666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1d6f-5710-430c-9ef4-1c133a2110cd None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:44.186160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 655/1293] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:44.197009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf3bb-c1c1-44f6-b2ec-5e9cb8b9883c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:44.197768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf3bb-c1c1-44f6-b2ec-5e9cb8b9883c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:44.197921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf3bb-c1c1-44f6-b2ec-5e9cb8b9883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:44.222330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-522cf3bb-c1c1-44f6-b2ec-5e9cb8b9883c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:44.223564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-522cf3bb-c1c1-44f6-b2ec-5e9cb8b9883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:44.254622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:44.294723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 639/1294] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:44 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:44.317624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1d6f-5710-430c-9ef4-1c133a2110cd None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:44.353129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:44.429381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1d6f-5710-430c-9ef4-1c133a2110cd None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:44.465852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:44.466467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:44.466748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:44.467027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:44.467755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:44.469139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076def-b63b-4cd9-9039-9b95ad2171a4 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:44.488282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 656/1295] 10.222.0.100 () {60 vars in 1146 bytes} [Fri Aug 5 20:34:44 2022] POST /identity/v3/services => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:34:46.535548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9e4a-ee26-4528-907b-0238f4eb12b7 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:46.536398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9e4a-ee26-4528-907b-0238f4eb12b7 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:46.536398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9e4a-ee26-4528-907b-0238f4eb12b7 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:46.538615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 640/1296] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:46.544622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:46.545060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:46.545148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:46.565557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:46.566763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:46.647969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 657/1297] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:46 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:46.672162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9e4a-ee26-4528-907b-0238f4eb12b7 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:46.802585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d9e4a-ee26-4528-907b-0238f4eb12b7 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:46.836149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:46.836811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:46.837122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:46.837556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:46.838193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:46.839593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:46.848668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:46.849744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:46.850746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 641/1298] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:34:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:46.856997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:46.886496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:46.973089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84742a9a-067a-4a30-89f4-2172c68e9e1c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:47.007294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:47.007944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:47.008220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:47.008498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:47.009192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:47.009500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:47.010881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:47.016199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 658/1299] 10.222.0.100 () {56 vars in 1121 bytes} [Fri Aug 5 20:34:46 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:34:47.022537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:47.057387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:47.135627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424425cb-a373-4c17-ba6c-058daf1b77f4 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:47.171820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:47.172441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:47.172717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:47.172986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:47.173740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] RBAC: Adding query filter params (interface=public, service_id=d75215a5310247568b58ad24976c85c5, region_id=RegionOne) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:47.174047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:47.175402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d23898-fd6f-4115-a14f-f20706daf30a None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:47.180783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 642/1300] 10.222.0.100 () {56 vars in 1256 bytes} [Fri Aug 5 20:34:47 2022] GET /identity/v3/endpoints?service_id=d75215a5310247568b58ad24976c85c5&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:47.187697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:47.286676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:47.305809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b208-504d-4ed4-b41e-fba5120f2a38 None admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:47.341073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:47.341725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:47.342011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:47.342285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:47.342943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:47.344370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f06b5-5a64-4b70-9511-f0133ee1f482 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:47.351701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 659/1301] 10.222.0.100 () {56 vars in 1092 bytes} [Fri Aug 5 20:34:47 2022] GET /identity/v3/services => generated 2201 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:34:49.350970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92c2f-e626-471f-9198-9ec1f02b7ef3 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:49.351859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92c2f-e626-471f-9198-9ec1f02b7ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:49.351859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92c2f-e626-471f-9198-9ec1f02b7ef3 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:49.354022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 643/1302] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:34:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:34:49.363030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:49.363485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:49.363691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:49.385475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:34:49.386767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:34:49.461751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 660/1303] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:34:49 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 20:34:49.497448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92c2f-e626-471f-9198-9ec1f02b7ef3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:49.604484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:49.611856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92c2f-e626-471f-9198-9ec1f02b7ef3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:49.651655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:49.652291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:49.652600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:49.652835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:49.653460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:49.654810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 20:34:49.665012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 20:34:49.666190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application with Lock( Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self._enter() Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application return self.creator() Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application created_value = creator( Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: ERROR keystone.server.flask.application Aug 05 20:34:49.667125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 644/1304] 10.222.0.100 () {56 vars in 1122 bytes} [Fri Aug 5 20:34:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 20:34:49.672701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:49.758077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:34:49.783577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7b5d8-6ce6-4387-a978-79ee90b4556c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:49.818885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:49.819558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:49.819832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:49.820098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] PATH_INFO: `/v3/services` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:49.820774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:34:49.821559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:49.822952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6c85-9c92-4fa4-a4e5-95bfede9edb2 None admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:49.828291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 661/1305] 10.222.0.100 () {56 vars in 1121 bytes} [Fri Aug 5 20:34:49 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:34:49.837555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:34:49.954956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cce67-c9c4-4ca6-9eae-c9b40b578c69 None admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:34:49.995577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:34:49.996230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:34:49.996500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:34:49.996766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:34:49.997473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:34:49.998852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621197-faa3-4070-a2e5-09ece65b3709 None admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:34:50.021214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 645/1306] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:34:49 2022] POST /identity/v3/endpoints => generated 333 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:34:59.825113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=30 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:00.016751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:53.845189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34aa7-184a-4747-b0b8-9832f4aaf998 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:53.845767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34aa7-184a-4747-b0b8-9832f4aaf998 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:53.845767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34aa7-184a-4747-b0b8-9832f4aaf998 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:53.850804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 662/1307] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:35:53 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:35:53.852251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e9eb-3874-4d7b-9430-d93bee93015c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:53.852644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e9eb-3874-4d7b-9430-d93bee93015c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:53.852838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e9eb-3874-4d7b-9430-d93bee93015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:54.013412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1db8e9eb-3874-4d7b-9430-d93bee93015c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:35:54.015538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1db8e9eb-3874-4d7b-9430-d93bee93015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:54.174104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 646/1308] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:35:54.222897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:54.223312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:54.223686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:54.225267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 663/1309] 10.222.0.100 () {54 vars in 970 bytes} [Fri Aug 5 20:35:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:35:54.231492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf53d3-8b25-4fcd-9657-a5da7ca99845 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:54.231790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf53d3-8b25-4fcd-9657-a5da7ca99845 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:54.232075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf53d3-8b25-4fcd-9657-a5da7ca99845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:54.318280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-cfbf53d3-8b25-4fcd-9657-a5da7ca99845 None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:35:54.319643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cfbf53d3-8b25-4fcd-9657-a5da7ca99845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:54.343333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:54.415772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 647/1310] 10.222.0.100 () {58 vars in 1067 bytes} [Fri Aug 5 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:35:54.425243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:35:54.427206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:54.540252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c7eb-bc5f-412f-a8dd-5561ab3f7ce0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:35:54.617688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:35:54.618482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:54.618871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:54.619251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:54.621089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:54.680105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:54.741646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:35:54.743278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d5df-3b7a-4e02-8ba5-042cd9a4433e service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:35:54.765781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 664/1311] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:35:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:35:57.048502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb227d-8715-40bf-8091-891736c052af None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:57.049147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb227d-8715-40bf-8091-891736c052af None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:57.049147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb227d-8715-40bf-8091-891736c052af None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:57.050661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 648/1312] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:35:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:35:57.055816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a088d-50e4-4ce6-aa14-2380d3b40c2f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:57.056278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a088d-50e4-4ce6-aa14-2380d3b40c2f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:57.056372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a088d-50e4-4ce6-aa14-2380d3b40c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:57.130870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a16a088d-50e4-4ce6-aa14-2380d3b40c2f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:35:57.132114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a16a088d-50e4-4ce6-aa14-2380d3b40c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:57.241233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 665/1313] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:35:57.294362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:57.294634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:57.294921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:57.296364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 649/1314] 10.222.0.100 () {54 vars in 970 bytes} [Fri Aug 5 20:35:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:35:57.303676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d177df-150c-47da-8c21-2795932ae67f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:57.304116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d177df-150c-47da-8c21-2795932ae67f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:57.304405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d177df-150c-47da-8c21-2795932ae67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:57.317184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:57.395535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-15d177df-150c-47da-8c21-2795932ae67f None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:35:57.396793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-15d177df-150c-47da-8c21-2795932ae67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:57.486291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 666/1315] 10.222.0.100 () {58 vars in 1067 bytes} [Fri Aug 5 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:35:57.495474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:35:57.496958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:57.603476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55622816-29d5-4bd5-91dd-e3bf142398b8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:35:57.681824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:35:57.684910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:35:57.685695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:35:57.685969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:35:57.686260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:35:57.688449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:35:57.803453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:35:57.804903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7f9f-dc68-4000-bf81-2f5a453042bf service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:35:57.823696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 650/1316] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:35:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:36:00.345894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:00.346726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:00.346726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:00.348829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 667/1317] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:00.356055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f67da-5c88-43ee-8539-ec4f79e3774d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:00.356794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f67da-5c88-43ee-8539-ec4f79e3774d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:00.356985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f67da-5c88-43ee-8539-ec4f79e3774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:00.440572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-716f67da-5c88-43ee-8539-ec4f79e3774d None None] MFA Rules not processed for user `b5638f33a9624f84876f38d01842977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:00.441819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-716f67da-5c88-43ee-8539-ec4f79e3774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:00.503864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:00.554787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 651/1318] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:00.602630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:00.605117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:00.729135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26efb5-d787-4db5-a992-9333731469ca None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:00.732079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:00.820399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:00.821029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:00.821309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:00.821587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:00.823244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:00.949300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:00.950758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d95f85-2e57-4625-8d4e-6ffd18c2a57d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:00.969766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 668/1319] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:00 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:03.586341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:03.587200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:03.587200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:03.589410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 652/1320] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:03.594991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cabf9-a9ae-4301-bde3-ca534fa322ec None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:03.595431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cabf9-a9ae-4301-bde3-ca534fa322ec None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:03.595592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cabf9-a9ae-4301-bde3-ca534fa322ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:03.640476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:03.669052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6c5cabf9-a9ae-4301-bde3-ca534fa322ec None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:03.670274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6c5cabf9-a9ae-4301-bde3-ca534fa322ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:03.771477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 669/1321] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:03.814018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:03.815626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:03.933872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef12b-c53b-4fc8-a316-c102b98f276d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:04.015317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:04.015985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:04.016272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:04.016544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:04.018190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:04.026455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:04.138195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:04.139675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd32a-72e1-45f0-8a3e-1191c6bd4c68 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:04.159932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 653/1322] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:06.871649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:06.872244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:06.872244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:06.873580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 670/1323] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:06.879038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15bc92-65ba-4137-b6e5-1e8d713d93d4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:06.879530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15bc92-65ba-4137-b6e5-1e8d713d93d4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:06.879622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15bc92-65ba-4137-b6e5-1e8d713d93d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:06.950310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6a15bc92-65ba-4137-b6e5-1e8d713d93d4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:06.951590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6a15bc92-65ba-4137-b6e5-1e8d713d93d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:07.016848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:07.063751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 654/1324] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:07.100670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:07.102239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:07.217888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37a10-d085-4315-95c3-8d76fd643339 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:07.231047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:07.297630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:07.298269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:07.298552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:07.298824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:07.300536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:07.419438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:07.420809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616894f0-9a4e-4909-ab16-3b643dbe6417 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:07.440529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 671/1325] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:09.508233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:09.508788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:09.508788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:09.510041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 655/1326] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:09.516103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b22e7-513b-4e81-8d3a-f2cb56f00628 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:09.516591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b22e7-513b-4e81-8d3a-f2cb56f00628 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:09.516697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b22e7-513b-4e81-8d3a-f2cb56f00628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:09.570391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:09.590972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c13b22e7-513b-4e81-8d3a-f2cb56f00628 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:09.592223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c13b22e7-513b-4e81-8d3a-f2cb56f00628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:09.694980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 672/1327] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:09.732168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:09.733718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:09.844294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca19e8-eb49-4683-b5df-fafbedf9b075 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:09.929743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:09.930383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:09.930666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:09.930944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:09.932629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:09.951061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:10.054070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:10.055569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb87db6-5392-4216-a63d-7c522bb7d4f5 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:10.083299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 656/1328] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:12.176927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:12.177503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:12.177503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:12.178846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 673/1329] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:12.185171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e29b-c3c2-464d-9e4b-21a8c896325b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:12.185733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e29b-c3c2-464d-9e4b-21a8c896325b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:12.185733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e29b-c3c2-464d-9e4b-21a8c896325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:12.257698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8874e29b-c3c2-464d-9e4b-21a8c896325b None None] MFA Rules not processed for user `b5638f33a9624f84876f38d01842977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:12.258916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8874e29b-c3c2-464d-9e4b-21a8c896325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:12.334465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:12.368411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 657/1330] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:12.406071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:12.408022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:12.517706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5540-9829-4929-8ac8-69880e1c9093 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:12.538507 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:12.591379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:12.592006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:12.592280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:12.592548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:12.594170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:12.724641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:12.726248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537aec9-99ec-4d69-bad4-29829339fd22 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:12.747125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 674/1331] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:15.180594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:15.181127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:15.181127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:15.182419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 658/1332] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:15.188175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9e9b-7c42-428e-8461-b81404fb63e2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:15.188644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9e9b-7c42-428e-8461-b81404fb63e2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:15.188744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9e9b-7c42-428e-8461-b81404fb63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:15.257467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:15.260272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ccde9e9b-7c42-428e-8461-b81404fb63e2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:15.261792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ccde9e9b-7c42-428e-8461-b81404fb63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:15.363021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 675/1333] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:15.402400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:15.403983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:15.513248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5dab0-dc18-49a4-b95d-6bccb1381bb6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:15.601542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:15.602174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:15.602460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:15.602728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:15.604411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:15.632940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:15.720713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:15.722174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15531cd5-dfb6-4b8b-b49c-48f352581d5c service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:15.740984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 659/1334] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:15 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:36:17.777143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:17.777715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:17.777891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:17.779328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 676/1335] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:17.788100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c28f5-4c2b-468a-9164-22815a62ef7e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:17.788517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c28f5-4c2b-468a-9164-22815a62ef7e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:17.788713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c28f5-4c2b-468a-9164-22815a62ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:17.865976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-580c28f5-4c2b-468a-9164-22815a62ef7e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:17.867202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-580c28f5-4c2b-468a-9164-22815a62ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:17.955986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:17.982033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 660/1336] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:18.026203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:18.028215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:18.140037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b88c78-967d-49bf-a7cf-cfad2df582a3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:18.172611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:18.224719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:18.225263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:18.225542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:18.225817 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:18.227510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:18.341165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:18.342614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7ae37-6634-4df9-bc4b-bb6e7673ef1a service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:18.364601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 677/1337] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:36:20.862235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:20.863105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:20.863105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:20.865466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 661/1338] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:20 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:20.871686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a26-cf5d-4701-8ee1-9bbf09933644 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:20.872140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a26-cf5d-4701-8ee1-9bbf09933644 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:20.872236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a26-cf5d-4701-8ee1-9bbf09933644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:20.945275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-18716a26-cf5d-4701-8ee1-9bbf09933644 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:20.946488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-18716a26-cf5d-4701-8ee1-9bbf09933644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:20.955005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:21.054579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 678/1339] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:21.098898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:21.100963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:21.210824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf5c11-000d-4b5e-88fc-5fba97655369 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:21.290273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:21.290900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:21.291184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:21.291471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:21.293298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:21.332786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:21.413844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:21.415281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee83c2-9c38-42b8-b410-a01d7450d594 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:21.434402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 662/1340] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:25.548932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:25.549486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:25.549486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:25.550859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 679/1341] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:25.556202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155d4-a4ce-4df8-a794-e0d20316a145 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:25.556661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155d4-a4ce-4df8-a794-e0d20316a145 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:25.556749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155d4-a4ce-4df8-a794-e0d20316a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:25.626980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ade155d4-a4ce-4df8-a794-e0d20316a145 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:25.628228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ade155d4-a4ce-4df8-a794-e0d20316a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:25.720432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:25.733796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 663/1342] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:25.772969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:25.774578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:25.886126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3cbf0-43e3-4b56-a848-4e815a2d7aa5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:25.923889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:25.959521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:25.960051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:25.960329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:25.960597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:25.962251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:26.084693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:26.086156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30e07-6025-4d92-9478-3d4ad48c1bd6 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:26.106295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 680/1343] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:28.748926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:28.749503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:28.749503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:28.750892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 664/1344] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:28.756806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4de9-7572-4e5a-838d-dcbbf2db2c3c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:28.757350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4de9-7572-4e5a-838d-dcbbf2db2c3c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:28.757350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4de9-7572-4e5a-838d-dcbbf2db2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:28.830513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d33e4de9-7572-4e5a-838d-dcbbf2db2c3c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:28.832021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d33e4de9-7572-4e5a-838d-dcbbf2db2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:28.850579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:28.934055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 681/1345] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:28.971667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:28.973319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:29.082604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168136e-bc27-4b50-83ea-b33f9099d1fe None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:29.158437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:29.159061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:29.159345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:29.159649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:29.161300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:29.207312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:29.275130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:29.276636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b00926-3b2a-404d-b11e-21ab7cc70a4a service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:29.296408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 665/1346] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:33.309627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:33.310189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:33.310189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:33.311613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 682/1347] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:33.317868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036361-ccfd-4f54-8a81-5741e9413060 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:33.318307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036361-ccfd-4f54-8a81-5741e9413060 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:33.318412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036361-ccfd-4f54-8a81-5741e9413060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:33.390318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e6036361-ccfd-4f54-8a81-5741e9413060 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:33.391616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e6036361-ccfd-4f54-8a81-5741e9413060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:33.490910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:33.499701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 666/1348] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:33.533405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:33.534972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:33.669656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acd1dd-5567-43b9-9992-34ce76993ea5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:33.727375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:33.757865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:33.758578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:33.758918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:33.759252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:33.761231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:33.896899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:33.898393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3442-b192-493f-8dfe-100791c06962 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:33.931599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 683/1349] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:33 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:38.837273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7271c5-cd75-426c-b817-6186bc1228f1 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:38.837809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7271c5-cd75-426c-b817-6186bc1228f1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:38.837809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7271c5-cd75-426c-b817-6186bc1228f1 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:38.839820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 667/1350] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:36:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:38.852835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28705e9-3701-4b7b-9983-4157d9b30a99 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:38.853770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28705e9-3701-4b7b-9983-4157d9b30a99 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:38.854272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28705e9-3701-4b7b-9983-4157d9b30a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:38.960101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c28705e9-3701-4b7b-9983-4157d9b30a99 None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:38.961677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c28705e9-3701-4b7b-9983-4157d9b30a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:38.983303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:39.087500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 684/1351] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:43.146792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b844-0478-49a0-aaf0-6f2fe303bf70 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:43.147706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b844-0478-49a0-aaf0-6f2fe303bf70 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:43.147990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b844-0478-49a0-aaf0-6f2fe303bf70 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:43.149489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 668/1352] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:36:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:43.156146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605ab6-ae5c-4c91-8d50-15819b05b190 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:43.157120 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605ab6-ae5c-4c91-8d50-15819b05b190 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:43.157607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c605ab6-ae5c-4c91-8d50-15819b05b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:43.253886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2c605ab6-ae5c-4c91-8d50-15819b05b190 None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:43.256187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2c605ab6-ae5c-4c91-8d50-15819b05b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:43.343684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:43.388511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 685/1353] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:44.696925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47620f1-2911-49d9-9237-28c61e79350a None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:44.697471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47620f1-2911-49d9-9237-28c61e79350a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:44.697471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47620f1-2911-49d9-9237-28c61e79350a None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:44.699258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 669/1354] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:36:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:44.704317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e91c8-7923-4c9a-a4bc-dfbea0b07e23 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:44.704755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e91c8-7923-4c9a-a4bc-dfbea0b07e23 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:44.704990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e91c8-7923-4c9a-a4bc-dfbea0b07e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:44.787640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-691e91c8-7923-4c9a-a4bc-dfbea0b07e23 None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:44.788878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-691e91c8-7923-4c9a-a4bc-dfbea0b07e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:44.901302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 686/1355] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:36:48.334254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfffac-d1ae-4296-93d0-00672c4663a3 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:48.335187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfffac-d1ae-4296-93d0-00672c4663a3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:48.335700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfffac-d1ae-4296-93d0-00672c4663a3 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:48.337481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 670/1356] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:48.343271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c974-04b4-49e9-938e-b663098eaf77 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:48.345053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c974-04b4-49e9-938e-b663098eaf77 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:48.345542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631c974-04b4-49e9-938e-b663098eaf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:48.393373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:48.430373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2631c974-04b4-49e9-938e-b663098eaf77 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:48.431842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2631c974-04b4-49e9-938e-b663098eaf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:48.547091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 687/1357] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:48.603536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:48.604128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:48.604650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:48.606531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 671/1358] 10.222.0.100 () {54 vars in 967 bytes} [Fri Aug 5 20:36:48 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:48.618308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf960-dd4e-42af-9d17-4aa317229e0b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:48.619242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf960-dd4e-42af-9d17-4aa317229e0b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:48.619956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf960-dd4e-42af-9d17-4aa317229e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:48.717099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-79daf960-dd4e-42af-9d17-4aa317229e0b None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:48.718317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-79daf960-dd4e-42af-9d17-4aa317229e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:48.774519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:48.849836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 688/1359] 10.222.0.100 () {58 vars in 1064 bytes} [Fri Aug 5 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:48.858266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:48.860524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:49.033837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7eae8-0944-47b7-b9eb-50ce62fb7097 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:49.114522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:49.164130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:49.164848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:49.165243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:49.165579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:49.167447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:49.263466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:49.265172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cf03a-04b7-4b8c-a193-c123082b6ad2 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:49.284677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 672/1360] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:51.517881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:51.518394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:51.518394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:51.520297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 689/1361] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:51.525969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7a1-6141-4ac0-a951-a07b1e763a72 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:51.526447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7a1-6141-4ac0-a951-a07b1e763a72 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:51.526715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7a1-6141-4ac0-a951-a07b1e763a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:51.603138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0880b7a1-6141-4ac0-a951-a07b1e763a72 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:51.604437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0880b7a1-6141-4ac0-a951-a07b1e763a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:51.654608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:51.747604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 673/1362] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:51.786686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:51.788265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:51.971509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2372-9887-4247-87df-7b34a527aa27 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:51.983023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:52.093475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:52.094136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:52.094469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:52.094820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:52.096569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:52.189502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:52.191123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9cca6-5e99-447e-835a-3493ac13a634 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:52.211266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 690/1363] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:54.552612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91050-6241-4348-9452-a0e93a45157c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:54.553186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91050-6241-4348-9452-a0e93a45157c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:54.553186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91050-6241-4348-9452-a0e93a45157c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:54.554550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 674/1364] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:54.562812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94baf-dd60-43d9-95e1-5c3a94ebc2af None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:54.562812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94baf-dd60-43d9-95e1-5c3a94ebc2af None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:54.562812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94baf-dd60-43d9-95e1-5c3a94ebc2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:54.577766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:54.641126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-25a94baf-dd60-43d9-95e1-5c3a94ebc2af None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:54.642486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-25a94baf-dd60-43d9-95e1-5c3a94ebc2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:54.746792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 691/1365] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:54.792302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:54.792613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:54.792974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:54.794744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 675/1366] 10.222.0.100 () {54 vars in 967 bytes} [Fri Aug 5 20:36:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:54.800552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e10bf-5302-47d8-bdb2-81071d036328 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:54.800983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e10bf-5302-47d8-bdb2-81071d036328 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:54.801363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e10bf-5302-47d8-bdb2-81071d036328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:54.883002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7c2e10bf-5302-47d8-bdb2-81071d036328 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:54.884352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7c2e10bf-5302-47d8-bdb2-81071d036328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:54.921853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:55.017421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 692/1367] 10.222.0.100 () {58 vars in 1064 bytes} [Fri Aug 5 20:36:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:55.025655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:55.027636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:55.185243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427154-900a-4b1c-a2e5-8f56e871bde1 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:55.207576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:55.310949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:55.311790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:55.312178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:55.312534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:55.314287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:55.410825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:55.412641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84452ad9-82ba-4fdc-98b9-45ba62341b30 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:55.434351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 676/1368] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:36:56.308280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455b98-812a-41c8-8bf1-ea64f11eae90 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:56.308797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455b98-812a-41c8-8bf1-ea64f11eae90 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:56.308797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455b98-812a-41c8-8bf1-ea64f11eae90 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:56.310379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 693/1369] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:56.316171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a060a-e543-4f50-a415-431fccda544f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:56.316595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a060a-e543-4f50-a415-431fccda544f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:56.316739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a060a-e543-4f50-a415-431fccda544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:56.350753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:56.390548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-779a060a-e543-4f50-a415-431fccda544f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:56.391911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-779a060a-e543-4f50-a415-431fccda544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:56.500217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 677/1370] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:56.859892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:56.860301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:56.860658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:56.862295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 694/1371] 10.222.0.100 () {54 vars in 969 bytes} [Fri Aug 5 20:36:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:36:56.867626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e6d7-ecd7-46ef-8f12-cff272e87849 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:56.868061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e6d7-ecd7-46ef-8f12-cff272e87849 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:56.868422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e6d7-ecd7-46ef-8f12-cff272e87849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:56.949498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8dc7e6d7-ecd7-46ef-8f12-cff272e87849 None None] MFA Rules not processed for user `c2828c36b4144b0098071053b9436388`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:56.950880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8dc7e6d7-ecd7-46ef-8f12-cff272e87849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:57.004936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:57.037958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 678/1372] 10.222.0.100 () {58 vars in 1066 bytes} [Fri Aug 5 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:57.045809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:57.047475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:57.164342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fdd13-c468-454d-8dfc-81aad1ef38ae None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:57.209738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:57.250463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:57.251251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:57.251654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:57.252030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:57.253821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:57.375423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:57.377001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34574-a367-4686-bb06-0615265aa556 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:57.400463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 695/1373] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:36:57.517428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:57.518406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:57.518406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:57.523277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 679/1374] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:36:57 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:36:57.524768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564da-d435-45f8-9985-fd1f1a020a6e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:57.525032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564da-d435-45f8-9985-fd1f1a020a6e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:57.525525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564da-d435-45f8-9985-fd1f1a020a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:57.627713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-153564da-d435-45f8-9985-fd1f1a020a6e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:36:57.629777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-153564da-d435-45f8-9985-fd1f1a020a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:57.667081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:57.775919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 696/1375] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:36:57.848470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:36:57.851280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:58.020661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681624fe-8aa5-4dde-9cf8-691b873fb7fb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:36:58.076095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:58.143119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:36:58.143712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:36:58.143998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:36:58.144267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:36:58.146406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:36:58.237651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:36:58.239298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d881-b53b-422d-8077-6bc0b2038b40 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:36:58.257923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 680/1376] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:00.305307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:00.305825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:00.305907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:00.307349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 697/1377] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:00.312748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac8d-4ae4-4a24-9a07-960debdfb624 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:00.313197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac8d-4ae4-4a24-9a07-960debdfb624 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:00.313328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aac8d-4ae4-4a24-9a07-960debdfb624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:00.406876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f60aac8d-4ae4-4a24-9a07-960debdfb624 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:00.408404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f60aac8d-4ae4-4a24-9a07-960debdfb624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:00.415601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:00.507023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 681/1378] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:00.551177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:00.552909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:00.713513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f747-1721-43db-a081-07ad3f7a5e4d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:00.717970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:00.869761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:00.870397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:00.870681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:00.870967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:00.872672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:00.998330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:01.000026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28434ef-0ce4-4127-ba66-df4ffef430bc service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:01.020514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 698/1379] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:03.067918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:03.068385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:03.068464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:03.069804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 682/1380] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:03.076089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd590-7894-4edd-9885-6e66af4002f2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:03.076525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd590-7894-4edd-9885-6e66af4002f2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:03.076693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd590-7894-4edd-9885-6e66af4002f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:03.088254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:03.154537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ab5cd590-7894-4edd-9885-6e66af4002f2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:03.155771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ab5cd590-7894-4edd-9885-6e66af4002f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:03.261941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 699/1381] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:03.307828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:03.310013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:03.467792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:03.484404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e194c1-51ce-4657-a538-96f915dc0439 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:03.631546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:03.632289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:03.632671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:03.633045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:03.635070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:03.759069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:03.761708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd75bb7-7f96-4eb9-8cfa-17184c253ebf service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:03.772980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:03.784939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 683/1382] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:05.843119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:05.843813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:05.843813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:05.845669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 700/1383] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:05.851071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15406-e573-4182-b9cf-b53d47506efa None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:05.851527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15406-e573-4182-b9cf-b53d47506efa None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:05.851643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15406-e573-4182-b9cf-b53d47506efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:05.920043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-14d15406-e573-4182-b9cf-b53d47506efa None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:05.921291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-14d15406-e573-4182-b9cf-b53d47506efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:06.024053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 684/1384] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:06.069519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:06.071045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:06.162207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:06.235218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3f85-31d1-4905-8908-8bec971a7e28 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:06.366075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:06.366622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:06.366893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:06.367219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:06.368931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:06.427835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:06.472365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:06.474008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb69200-b0c7-4625-a154-494caadfbfa8 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:06.492205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 701/1385] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:08.485361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:08.486085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:08.486085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:08.487268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 685/1386] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:08.492530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe95ff-c08a-4bab-97e4-b907edaf1a48 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:08.493112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe95ff-c08a-4bab-97e4-b907edaf1a48 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:08.493314 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe95ff-c08a-4bab-97e4-b907edaf1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:08.563858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-27fe95ff-c08a-4bab-97e4-b907edaf1a48 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:08.565094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-27fe95ff-c08a-4bab-97e4-b907edaf1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:08.716813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 702/1387] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:37:08.772019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:08.773757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:08.879852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:08.992287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e4f0-5296-4565-b4e7-700d413c8d56 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:09.126806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:09.127477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:09.127828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:09.128157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:09.130113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:09.173627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:09.227611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:09.229258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714ed6c-d71b-4db5-a2f1-99b5c116f611 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:09.248466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 686/1388] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:37:11.318856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:11.319447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:11.319554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:11.321244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 703/1389] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:11.327393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464eca-77ee-41ae-91e2-c0ee14140cfc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:11.327841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464eca-77ee-41ae-91e2-c0ee14140cfc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:11.327948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef464eca-77ee-41ae-91e2-c0ee14140cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:11.403809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ef464eca-77ee-41ae-91e2-c0ee14140cfc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:11.405002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ef464eca-77ee-41ae-91e2-c0ee14140cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:11.513128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 687/1390] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:11.558064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:11.559647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:11.592820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:11.715920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79749244-2032-4818-bba6-cc8aedd77c5e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:11.825843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:11.839946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:11.840576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:11.840857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:11.841265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:11.843013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:11.938098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:11.939777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc21b-5821-46b5-ae61-caba9039b01a service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:11.960201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 704/1391] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:13.274980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531f08-c58b-4df4-a8a3-021b326975bd None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.275543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531f08-c58b-4df4-a8a3-021b326975bd None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.275543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531f08-c58b-4df4-a8a3-021b326975bd None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.277083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 688/1392] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:13.282635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad621c-ce71-4e9a-81f5-5ac9dc48b719 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.283080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad621c-ce71-4e9a-81f5-5ac9dc48b719 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.283635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad621c-ce71-4e9a-81f5-5ac9dc48b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.353829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c6ad621c-ce71-4e9a-81f5-5ac9dc48b719 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:13.355034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c6ad621c-ce71-4e9a-81f5-5ac9dc48b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:13.418516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:13.460400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 705/1393] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:13.516526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.516837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.517087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.518608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 689/1394] 10.222.0.100 () {54 vars in 971 bytes} [Fri Aug 5 20:37:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:13.523743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898ae8-8d27-46c3-b1e3-9852a82257c9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.524031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898ae8-8d27-46c3-b1e3-9852a82257c9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.524306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898ae8-8d27-46c3-b1e3-9852a82257c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.602604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0c898ae8-8d27-46c3-b1e3-9852a82257c9 None None] MFA Rules not processed for user `f1522c66319745588bc60119696076db`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:13.603731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0c898ae8-8d27-46c3-b1e3-9852a82257c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:13.684414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 706/1395] 10.222.0.100 () {58 vars in 1068 bytes} [Fri Aug 5 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:13.692044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:13.693615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:13.707618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:13.800896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411badc-6fde-42ba-95b9-5747158e8865 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:13.876317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:13.876860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.877132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.877424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.879065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:13.950744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:13.978537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d264f-10bd-431a-b0a2-8dc5f5eaaeed None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.978850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d264f-10bd-431a-b0a2-8dc5f5eaaeed None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.979113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d264f-10bd-431a-b0a2-8dc5f5eaaeed None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:13.981266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 707/1396] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:13.985928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce30b-468a-4178-962e-bd306ea2506d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:13.986216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce30b-468a-4178-962e-bd306ea2506d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:13.986495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce30b-468a-4178-962e-bd306ea2506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:14.011382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:14.012863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:14.031644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 690/1397] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:14.056680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-966ce30b-468a-4178-962e-bd306ea2506d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:14.058001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-966ce30b-468a-4178-962e-bd306ea2506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:14.067152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:14.162807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 708/1398] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:37:14.206953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:14.208253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:14.322086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3f9bc-c34d-45fa-a05d-f6ed01261bb1 service glance] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:14.392931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:14.446054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:14.446735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:14.446965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:14.447239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:14.449964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:14.546500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:14.548158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d88b0-e003-40bc-96fb-c8d69cf86d9a service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:14.567002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 691/1399] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:14.777813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e6af-6195-4157-9686-67853b39a2e2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:14.778380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e6af-6195-4157-9686-67853b39a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:14.778380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867e6af-6195-4157-9686-67853b39a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:14.848497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c867e6af-6195-4157-9686-67853b39a2e2 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:14.849715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c867e6af-6195-4157-9686-67853b39a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:14.940470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 709/1400] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:14.985870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:14.986190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:14.986476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:14.987918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 692/1401] 10.222.0.100 () {54 vars in 948 bytes} [Fri Aug 5 20:37:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:14.994214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a824bf-3b29-4bbb-a6fe-13837e3848cf None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:14.994505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a824bf-3b29-4bbb-a6fe-13837e3848cf None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:14.994784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a824bf-3b29-4bbb-a6fe-13837e3848cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:14.999732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:15.074962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f5a824bf-3b29-4bbb-a6fe-13837e3848cf None None] MFA Rules not processed for user `c5f9d739145b45f4a689648350d9ecda`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:15.076095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f5a824bf-3b29-4bbb-a6fe-13837e3848cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:15.184767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 710/1402] 10.222.0.100 () {58 vars in 1045 bytes} [Fri Aug 5 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3314 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:15.194551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:15.196249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:15.281380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:15.343455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127a72-0a5f-436d-a2b9-cf4664e6792f None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:15.454312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:15.454951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:15.455205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:15.455513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:15.457273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:15.530163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:15.551737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:15.553363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e79c-c823-49a2-b60e-149cc843c922 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:15.562323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 693/1403] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:37:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:37:16.649605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:16.650169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:16.650169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:16.651686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 711/1404] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:16.656975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4f5c-aaff-460f-90bc-1592548d6e5e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:16.657417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4f5c-aaff-460f-90bc-1592548d6e5e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:16.657539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4f5c-aaff-460f-90bc-1592548d6e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:16.732573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8b5a4f5c-aaff-460f-90bc-1592548d6e5e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:16.733944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8b5a4f5c-aaff-460f-90bc-1592548d6e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:16.850538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 694/1405] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:16.890476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:16.892136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:16.981620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:17.074233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb852e2e-0aa1-40bb-8136-89762aaa4d1a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:17.210313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:17.211398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:17.211898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:17.212381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:17.214119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:17.241191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:17.331204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:17.334680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da6186-6528-4701-832c-a7f023591c35 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:17.363383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 712/1406] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:19.455291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:19.455942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:19.455942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:19.457401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 695/1407] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:37:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:19.462812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efbbe-084d-47d2-b802-efa5c3bae6a5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:19.463287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efbbe-084d-47d2-b802-efa5c3bae6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:19.463431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efbbe-084d-47d2-b802-efa5c3bae6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:19.544282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-396efbbe-084d-47d2-b802-efa5c3bae6a5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:19.545533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-396efbbe-084d-47d2-b802-efa5c3bae6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:19.659839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:19.663405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 713/1408] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:19.723526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:19.725071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:19.796835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:19.892468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf084b2-ffdd-4cb3-a553-4f82c85b2b8c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:20.022280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:20.022917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:20.023205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:20.023517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:20.025172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:20.049614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:20.133701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:20.135794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e83bab-2570-4ece-8df5-4b8f020bf78b service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:20.156400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 696/1409] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:19 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:30.152989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=37 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:38.017946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1929-ecad-4a12-92c7-59fc4e9d4af7 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:38.018518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1929-ecad-4a12-92c7-59fc4e9d4af7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:38.018518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1929-ecad-4a12-92c7-59fc4e9d4af7 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:38.019824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 714/1410] 10.222.0.100 () {54 vars in 923 bytes} [Fri Aug 5 20:37:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:37:38.026172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2d95-ace4-4be6-9c94-a9b63912ce63 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:38.026699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2d95-ace4-4be6-9c94-a9b63912ce63 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:38.026810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b2d95-ace4-4be6-9c94-a9b63912ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:38.108819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-274b2d95-ace4-4be6-9c94-a9b63912ce63 None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:38.110055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-274b2d95-ace4-4be6-9c94-a9b63912ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:38.220838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 697/1411] 10.222.0.100 () {58 vars in 1020 bytes} [Fri Aug 5 20:37:38 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:38.238288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8fe9-3633-4c2c-97ae-a82c3fe31b3a None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:38.238570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8fe9-3633-4c2c-97ae-a82c3fe31b3a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:38.238844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8fe9-3633-4c2c-97ae-a82c3fe31b3a None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:38.240263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 715/1412] 10.222.0.100 () {54 vars in 923 bytes} [Fri Aug 5 20:37:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:38.245009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aff1c-daac-46d1-b710-75aa38eb0c3f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:38.245444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aff1c-daac-46d1-b710-75aa38eb0c3f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:38.245731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aff1c-daac-46d1-b710-75aa38eb0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:38.322120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:38.326057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ca1aff1c-daac-46d1-b710-75aa38eb0c3f None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:38.327962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ca1aff1c-daac-46d1-b710-75aa38eb0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:38.461511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 698/1413] 10.222.0.100 () {58 vars in 1020 bytes} [Fri Aug 5 20:37:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:37:40.992538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312cab-430f-4992-815e-008846db56e5 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:40.993058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312cab-430f-4992-815e-008846db56e5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:40.993058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312cab-430f-4992-815e-008846db56e5 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:40.994635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:37:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:41.003000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29159-a2ad-41dd-9e3e-7fffe0859368 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:41.003460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29159-a2ad-41dd-9e3e-7fffe0859368 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:41.003614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac29159-a2ad-41dd-9e3e-7fffe0859368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:41.086586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4ac29159-a2ad-41dd-9e3e-7fffe0859368 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:41.087877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4ac29159-a2ad-41dd-9e3e-7fffe0859368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:41.152983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:41.199925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:41.260084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312cab-430f-4992-815e-008846db56e5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:41.262214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-02312cab-430f-4992-815e-008846db56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:41.412280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312cab-430f-4992-815e-008846db56e5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:41.486650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:41.529298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:41.529838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:41.530110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:41.530344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:41.532027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:41.649065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:41.651496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655e1c-0f35-46a9-a659-a2cf2ffedca9 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:41.672589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 717/1416] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:42.584007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:42.584581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:42.584581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:42.585943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:42.592491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6801-fd53-4847-9ad5-a25a71f81c2b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:42.592980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6801-fd53-4847-9ad5-a25a71f81c2b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:42.593083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6801-fd53-4847-9ad5-a25a71f81c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:42.682102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-313f6801-fd53-4847-9ad5-a25a71f81c2b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:42.683321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-313f6801-fd53-4847-9ad5-a25a71f81c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:42.715325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:42.796470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:42.959713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:42.962115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:43.130172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2837734-8c5e-4bbc-9115-c105d9a085d0 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:43.177278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:43.253825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:43.254363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:43.254649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:43.254924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:43.256595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:43.356738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:43.358359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a85849-31f6-4125-8eb2-4d03477f35a7 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:43.377113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 701/1419] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:44.248999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:44.249582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:44.249582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:44.250911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:37:44.256239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6815d8-758f-4f61-8d98-c4cbb086bb41 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:44.256664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6815d8-758f-4f61-8d98-c4cbb086bb41 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:44.256774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6815d8-758f-4f61-8d98-c4cbb086bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:44.313164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:44.337413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9c6815d8-758f-4f61-8d98-c4cbb086bb41 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:44.338681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9c6815d8-758f-4f61-8d98-c4cbb086bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:44.453767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:44.605048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:44.607501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:44.769554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880affc-9518-43aa-b2bc-b972866c5b39 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:44.784381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:44.898218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:44.898769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:44.899087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:44.899393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:44.901135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:45.007214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:45.008973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc11c0d-058b-4f1f-b3d9-fe31e39c52b7 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:45.028199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 720/1422] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:45.902935 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:45.903591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:45.903591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:45.904910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:37:45.911559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d820-8fb0-45f2-a683-12e828ba7688 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:45.912071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d820-8fb0-45f2-a683-12e828ba7688 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:45.912071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d820-8fb0-45f2-a683-12e828ba7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:45.936781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:46.126655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-33f8d820-8fb0-45f2-a683-12e828ba7688 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:46.127826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-33f8d820-8fb0-45f2-a683-12e828ba7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:46.232896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:46.411703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:46.414089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:46.534686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:46.571007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c5a85-66ea-4ab1-ada8-edf5f3982ab2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:46.696174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:46.696788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:46.697065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:46.697329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:46.699207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:46.790010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:46.810581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:46.812256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7413f-f084-4f63-aaf9-e30fcee0457d service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:46.831697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 704/1425] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:47.700042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:47.700640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:47.700640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:47.701967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:47.708200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d08b-84a7-43be-92f9-09511ce6e22f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:47.708930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d08b-84a7-43be-92f9-09511ce6e22f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:47.709129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d08b-84a7-43be-92f9-09511ce6e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:47.795467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3305d08b-84a7-43be-92f9-09511ce6e22f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:47.796716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3305d08b-84a7-43be-92f9-09511ce6e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:47.917350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:48.070493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:48.072056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:48.176853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:48.247299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093606-fea8-46d0-8bde-bdec154c6430 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:48.380607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:48.381242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:48.381515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:48.381784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:48.383478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:48.442905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:48.485605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:48.487219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6e375-eae0-4654-879c-ce252d1011a7 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:48.505806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 723/1428] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:49.322521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:49.323072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:49.323183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:49.324664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:49.330673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c32e5-e604-4738-8143-54838317d7fd None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:49.331148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c32e5-e604-4738-8143-54838317d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:49.331260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c32e5-e604-4738-8143-54838317d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:49.416875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-541c32e5-e604-4738-8143-54838317d7fd None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:49.418090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-541c32e5-e604-4738-8143-54838317d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:49.521425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:49.678533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:49.680963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:49.740716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:49.873649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca429a50-9462-474a-b2f8-01e574c82ac3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:49.997085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:49.997710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:49.997992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:49.998269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:49.999946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:50.007091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:50.224554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:50.226092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2daecc-d612-41fb-992d-f971b1d3b9d4 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:50.245366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 707/1431] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:49 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:51.046805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:51.047380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:51.047380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:51.049450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:51.054551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccc52-5c93-4f88-b7c0-d37cb1285a46 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:51.055029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccc52-5c93-4f88-b7c0-d37cb1285a46 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:51.055138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccc52-5c93-4f88-b7c0-d37cb1285a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:51.131817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4e5ccc52-5c93-4f88-b7c0-d37cb1285a46 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:51.133052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4e5ccc52-5c93-4f88-b7c0-d37cb1285a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:51.230750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:51.261377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:51.415514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:51.418639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:51.442992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:51.593721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54695e-1a44-420f-910d-d43a2e327100 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:51.685977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:51.716851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:51.717471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:51.718044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:51.718321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:51.720043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:51.829133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:51.830761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7db6f-1ef1-4e4f-97f9-91e1c9de6948 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:51.849529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 726/1434] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:52.649979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:52.650545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:52.650545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:52.651993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:52.658360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7427-21cd-42ae-9750-8919b560e22f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:52.659313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7427-21cd-42ae-9750-8919b560e22f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:52.659313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7427-21cd-42ae-9750-8919b560e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:52.742846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b43a7427-21cd-42ae-9750-8919b560e22f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:52.744064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b43a7427-21cd-42ae-9750-8919b560e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:52.792096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:52.850364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:53.000253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:53.001704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:53.164143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a76d-c117-4f91-b97f-5cf57cd78b1c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:53.223610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:53.290208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:53.290764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:53.291067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:53.291553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:53.293130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:53.389066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:53.390673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b837-30a6-42a3-88be-beb488874236 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:53.409536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 710/1437] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:54.222889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:54.223522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:54.223522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:54.224847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:37:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:54.231765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022410ab-7fa7-47e3-a1a6-91b8782bab36 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:54.232187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022410ab-7fa7-47e3-a1a6-91b8782bab36 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:54.232304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022410ab-7fa7-47e3-a1a6-91b8782bab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:54.318289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-022410ab-7fa7-47e3-a1a6-91b8782bab36 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:54.319541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-022410ab-7fa7-47e3-a1a6-91b8782bab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:54.321603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:54.446326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:54.600583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:54.603225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:54.766086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed758daa-840b-48f2-96bb-1be3a84588bb None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:54.796302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:54.884354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:54.885125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:54.885837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:54.886122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:54.887835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:54.988127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:54.989747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e0df4-c7ab-4ce1-bcd7-6c1bbde812e7 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:55.008121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 729/1440] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:56.917886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:56.919090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:56.919090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:56.920037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:37:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:56.927964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a81d-cde8-4715-87ef-3c0e847bcd46 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:56.928371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a81d-cde8-4715-87ef-3c0e847bcd46 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:56.928514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a81d-cde8-4715-87ef-3c0e847bcd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:56.978783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:57.006693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7662a81d-cde8-4715-87ef-3c0e847bcd46 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:57.008004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7662a81d-cde8-4715-87ef-3c0e847bcd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:57.123226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:37:57.165836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:57.167846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:57.280375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b779a1b-9a6e-4ac8-a6f7-a23a2335d509 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:37:57.314843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:57.361831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:37:57.362492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:57.362777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:57.363057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:57.364729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:57.483748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:37:57.485978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df776840-d6c2-4978-92d7-4870e82ed75b service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:37:57.508459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 713/1443] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:59.673487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:59.674127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:59.674127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:59.675394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:37:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:37:59.680976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c53f0-7b08-490e-bb37-12312d371875 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:37:59.681425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c53f0-7b08-490e-bb37-12312d371875 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:37:59.681528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c53f0-7b08-490e-bb37-12312d371875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:37:59.750778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-608c53f0-7b08-490e-bb37-12312d371875 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:37:59.752005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-608c53f0-7b08-490e-bb37-12312d371875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:37:59.765800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:59.857664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:37:59.896504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:37:59.898085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:00.012535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcae5c-8bd5-4e4c-9fe3-249a8287f932 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:00.026047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:00.092368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:00.092996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:00.093277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:00.093547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:00.095218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:00.207153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:00.208655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4139f8e-2f87-414d-843f-f43d5cedbf83 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:00.229030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 732/1446] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:02.668146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:02.669061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:02.669061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:02.671290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:02.680164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb08-a644-4e34-865b-516c0066f076 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:02.680910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb08-a644-4e34-865b-516c0066f076 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:02.681079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb08-a644-4e34-865b-516c0066f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:02.733934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:02.753944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-aca1cb08-a644-4e34-865b-516c0066f076 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:02.755170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aca1cb08-a644-4e34-865b-516c0066f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:02.860462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:02.902968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:02.905513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:03.026923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a5858-61ea-473c-bb9c-67e185fc5828 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:03.068620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:03.103915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:03.105175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:03.105575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:03.105907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:03.108681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:03.230193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:03.231573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a03cb0-cf74-4f0d-a8b8-d22bec8a8923 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:03.251445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 716/1449] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:05.417598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:05.418440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:05.418440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:05.420688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:05.429871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f482-7b7d-49c7-abb2-2d6759d5eeff None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:05.430612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f482-7b7d-49c7-abb2-2d6759d5eeff None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:05.430968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60f482-7b7d-49c7-abb2-2d6759d5eeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:05.507328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6c60f482-7b7d-49c7-abb2-2d6759d5eeff None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:05.508563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6c60f482-7b7d-49c7-abb2-2d6759d5eeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:05.529841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:05.606671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:05.647893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:05.650372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:05.759432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6751e-62a2-44a4-a4ac-61004e81670b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:05.780392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:05.844025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:05.844648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:05.844928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:05.845189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:05.846814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:05.976936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:05.978416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038bfee-2555-4b89-88b1-8ea7e02651e5 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:05.998271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 735/1452] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:08.133942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:08.134474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:08.134474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:08.137387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:08.143141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee71-0529-44dc-a610-cc61cd901189 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:08.143650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee71-0529-44dc-a610-cc61cd901189 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:08.143756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407ee71-0529-44dc-a610-cc61cd901189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:08.213755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:08.216880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c407ee71-0529-44dc-a610-cc61cd901189 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:08.218896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c407ee71-0529-44dc-a610-cc61cd901189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:08.330513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:08.372628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:08.375075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:08.489642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b2b55-29c5-453b-a2da-abd8d6aada3b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:08.548356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:08.575225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:08.575876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:08.576159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:08.576435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:08.578067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:08.689957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:08.691410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b514f22-4060-4bbb-8e93-9f8059343868 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:08.710230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 719/1455] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:10.771550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:10.772522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:10.772522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:10.774974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:10.780509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c1f3-def3-4788-9f22-b243b3bf5002 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:10.780966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c1f3-def3-4788-9f22-b243b3bf5002 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:10.781058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18c1f3-def3-4788-9f22-b243b3bf5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:10.851540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8e18c1f3-def3-4788-9f22-b243b3bf5002 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:10.852684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8e18c1f3-def3-4788-9f22-b243b3bf5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:10.891966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:10.972200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:11.010572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:11.012186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:11.125400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22da56-d31c-4dd0-8d17-d1a38bdeabe1 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:11.157063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:11.203992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:11.204612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:11.204891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:11.205160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:11.206787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:11.332980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:11.334422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107e9e1-4e15-45c8-92b0-2fb8a091c91d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:11.353025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 738/1458] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:13.407100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:13.407974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:13.407974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:13.410581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:13 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:13.416905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338abb3-05b1-4415-8cec-d52a0661a803 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:13.417370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338abb3-05b1-4415-8cec-d52a0661a803 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:13.417563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338abb3-05b1-4415-8cec-d52a0661a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:13.490538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b338abb3-05b1-4415-8cec-d52a0661a803 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:13.491791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b338abb3-05b1-4415-8cec-d52a0661a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:13.500898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:13.594730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:13.635415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:13.637076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:13.756219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfa8ab-fac4-42d1-94f0-4cefe4d986e4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:13.818454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:13.838647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:13.839282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:13.839593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:13.839868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:13.841529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:13.956959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:13.958725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf189-8c03-4f08-8b44-1c21b65ce408 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:13.977930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 722/1461] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:15.997552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:15.998093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:15.998093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:15.999497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:16.006034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f143-baa6-42d0-96a6-346cbd9ee7b6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:16.006488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f143-baa6-42d0-96a6-346cbd9ee7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:16.006687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f143-baa6-42d0-96a6-346cbd9ee7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:16.078162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c3c1f143-baa6-42d0-96a6-346cbd9ee7b6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:16.079538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c3c1f143-baa6-42d0-96a6-346cbd9ee7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:16.122258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:16.185055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:16.222422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:16.224005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:16.332605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b0dde-07b5-4e69-8623-a245d08d7670 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:16.377448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:16.425356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:16.425987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:16.426262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:16.426534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:16.428625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:16.567988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:16.569419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea29208-b4ff-4484-8abd-9f4eb86070c9 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:16.597492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 741/1464] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:38:18.617896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:18.618430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:18.618430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:18.619999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:18.625510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2b4e2-741d-4ff7-9bc6-9a26c59bffde None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:18.625967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2b4e2-741d-4ff7-9bc6-9a26c59bffde None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:18.626063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2b4e2-741d-4ff7-9bc6-9a26c59bffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:18.698470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-42e2b4e2-741d-4ff7-9bc6-9a26c59bffde None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:18.699749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-42e2b4e2-741d-4ff7-9bc6-9a26c59bffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:18.718424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:18.802318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:18.841330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:18.842888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:18.968265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667512f-25e4-4f25-a40b-faf84789f860 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:19.052150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:19.061515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:19.062147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:19.062431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:19.062701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:19.064436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:19.182756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:19.184228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b529e-3723-431a-8d05-015fd93f414c service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:19.202852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 725/1467] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:18 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:38:21.254354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:21.254908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:21.254908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:21.257099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:38:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:21.264641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafec83-b3d5-4201-977c-e4a388cb0907 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:21.265067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafec83-b3d5-4201-977c-e4a388cb0907 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:21.265199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafec83-b3d5-4201-977c-e4a388cb0907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:21.337648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2eafec83-b3d5-4201-977c-e4a388cb0907 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:21.339308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2eafec83-b3d5-4201-977c-e4a388cb0907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:21.390359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:21.442754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:21.479607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:21.481166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:21.592660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9b0cb-695d-4cf8-9cc4-16ee9d5b228a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:21.644841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:21.673758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:21.674380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:21.674661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:21.674932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:21.676602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:21.795671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:21.797138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc8b3-1089-428d-9188-caa9ac5d4840 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:21.815680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 744/1470] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:21 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:31.440939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=22 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:31.813224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=66 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:41.283651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c24-7431-4a7f-9165-812ee1bfa6e2 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:41.284809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c24-7431-4a7f-9165-812ee1bfa6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:41.284809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c24-7431-4a7f-9165-812ee1bfa6e2 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:41.286753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 727/1471] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:41 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:41.293540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443cde-0d61-412b-8d61-f2bd9970fdcf None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:41.294155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443cde-0d61-412b-8d61-f2bd9970fdcf None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:41.294320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443cde-0d61-412b-8d61-f2bd9970fdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:41.372482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-81443cde-0d61-412b-8d61-f2bd9970fdcf None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:41.373709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-81443cde-0d61-412b-8d61-f2bd9970fdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:41.478702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 745/1472] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:41.577448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:41.577768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:41.578040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:41.579397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 728/1473] 10.222.0.100 () {54 vars in 971 bytes} [Fri Aug 5 20:38:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:41.585282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313e11-dae0-43e2-a92e-29f1a554d1a2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:41.585651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313e11-dae0-43e2-a92e-29f1a554d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:41.586058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313e11-dae0-43e2-a92e-29f1a554d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:41.670438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0e313e11-dae0-43e2-a92e-29f1a554d1a2 None None] MFA Rules not processed for user `f1522c66319745588bc60119696076db`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:41.672456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0e313e11-dae0-43e2-a92e-29f1a554d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:41.695473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:41.766979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 746/1474] 10.222.0.100 () {58 vars in 1068 bytes} [Fri Aug 5 20:38:41 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:41.774971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:41.776472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:41.897361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5aa8-1a91-438d-9c84-a3304816c117 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:41.984621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:41.985263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:41.985546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:41.985816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:41.987490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:42.045552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:42.107981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:42.109444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38f91-19a3-4f04-ab0e-db9f6cbdab02 service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:42.129714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 729/1475] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:41 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:44.209819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157814-3853-4946-9400-0c096193fadc None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:44.210698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157814-3853-4946-9400-0c096193fadc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:44.210698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157814-3853-4946-9400-0c096193fadc None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:44.212934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 747/1476] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:44.221831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d069-d905-4ddb-9827-bee448888587 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:44.222586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d069-d905-4ddb-9827-bee448888587 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:44.222743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0d069-d905-4ddb-9827-bee448888587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:44.300192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-aae0d069-d905-4ddb-9827-bee448888587 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:44.301416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-aae0d069-d905-4ddb-9827-bee448888587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:44.406267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 730/1477] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:44.430116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157814-3853-4946-9400-0c096193fadc None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:44.431695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-43157814-3853-4946-9400-0c096193fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:44.570279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157814-3853-4946-9400-0c096193fadc None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:44.619846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:44.667348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:44.667999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:44.668283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:44.668552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:44.669249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:44.670997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:38:44.670997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:38:44.670997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:38:44.672167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601b6e9-fc7a-46a4-ac32-5335af34cea9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:44.695757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 748/1478] 10.222.0.100 () {56 vars in 1113 bytes} [Fri Aug 5 20:38:44 2022] GET /identity/v3/projects => generated 2562 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:38:46.720012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:46.720609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:46.720609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:46.722734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 731/1479] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:46.731659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a3dc-17bd-4a24-ad63-1726a68dd491 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:46.732096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a3dc-17bd-4a24-ad63-1726a68dd491 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:46.732227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a3dc-17bd-4a24-ad63-1726a68dd491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:46.819917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c2e6a3dc-17bd-4a24-ad63-1726a68dd491 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:46.821128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c2e6a3dc-17bd-4a24-ad63-1726a68dd491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:46.921953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 749/1480] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:46.967541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:46.969051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:46.979731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:47.133859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d853-2e25-476d-9cb0-c6353cdd428b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:47.222317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:47.256619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:47.257170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:47.257454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:47.257731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:47.259430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:47.356111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:47.357708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9485ca-996a-4aaf-9e32-2bbd2217c8a3 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:47.376372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 732/1481] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:49.563332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:49.563962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:49.563962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:49.565308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 750/1482] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:49.571649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f54b3-facb-421d-8388-dc15dfe170a3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:49.572095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f54b3-facb-421d-8388-dc15dfe170a3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:49.572252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f54b3-facb-421d-8388-dc15dfe170a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:49.657980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ae1f54b3-facb-421d-8388-dc15dfe170a3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:49.659567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ae1f54b3-facb-421d-8388-dc15dfe170a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:49.708431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:49.768634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 733/1483] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:49.807672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:49.809295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:49.837832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:49.944762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3012fd-bd66-4149-a5b5-8e409fbf5f99 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:50.023133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:50.023788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:50.024073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:50.024346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:50.026064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:50.108961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:50.149093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:50.150675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce59632-042d-48e6-a53c-ef1641fc3ec2 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:50.170034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 751/1484] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:49 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:52.197417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:52.198251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:52.198372 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:52.200401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 734/1485] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:52 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:52.205869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a740-031b-4707-8d7a-6142cb3edad8 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:52.206381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a740-031b-4707-8d7a-6142cb3edad8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:52.206381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a740-031b-4707-8d7a-6142cb3edad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:52.280595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2ad9a740-031b-4707-8d7a-6142cb3edad8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:52.281898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2ad9a740-031b-4707-8d7a-6142cb3edad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:52.387283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 752/1486] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:52.430375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:52.433072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:52.556570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5f87-6f7f-47ec-b878-bf199b05b2c4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:52.633291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:52.635824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:52.636513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:52.636803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:52.637097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:52.639607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:52.770949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:52.772466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a243923-d1ee-4f34-9ed6-7a99c38be44d service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:52.792958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 735/1487] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:54.921094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:54.922109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:54.922109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:54.924411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 753/1488] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:54 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:38:54.931182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5b3c6-d51a-4d54-828b-ad12c707f499 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:54.932307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5b3c6-d51a-4d54-828b-ad12c707f499 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:54.932307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5b3c6-d51a-4d54-828b-ad12c707f499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:55.027619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-74f5b3c6-d51a-4d54-828b-ad12c707f499 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:55.028847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-74f5b3c6-d51a-4d54-828b-ad12c707f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:55.093473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:55.141043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 736/1489] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:55.182700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:55.184356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:55.221232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:55.308237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf41d-255a-41b9-a770-e51c42a31f36 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:55.385853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:55.386467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:55.386740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:55.387009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:55.388669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:55.478720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:55.513521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:55.515064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218ddf3-76ca-4f8b-98fa-7253eeab2bae service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:55.535709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 754/1490] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:38:57.747016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783770-797b-46e5-a15e-195e666407fc None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:57.747664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783770-797b-46e5-a15e-195e666407fc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:57.747664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783770-797b-46e5-a15e-195e666407fc None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:57.749010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 737/1491] 10.222.0.100 () {54 vars in 932 bytes} [Fri Aug 5 20:38:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:38:57.755524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ff5b-3af3-45e7-9847-e00aa22c75fc None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:57.756259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ff5b-3af3-45e7-9847-e00aa22c75fc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:57.756420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ff5b-3af3-45e7-9847-e00aa22c75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:57.837395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cca3ff5b-3af3-45e7-9847-e00aa22c75fc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:38:57.838631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cca3ff5b-3af3-45e7-9847-e00aa22c75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:57.952620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 755/1492] 10.222.0.100 () {58 vars in 1029 bytes} [Fri Aug 5 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:38:58.001858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783770-797b-46e5-a15e-195e666407fc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:38:58.003382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3a783770-797b-46e5-a15e-195e666407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:58.115013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783770-797b-46e5-a15e-195e666407fc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:38:58.200095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:38:58.200752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:38:58.201030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:38:58.201283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:38:58.202943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:38:58.213901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:58.330818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:38:58.332209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a703916-0ca5-4b65-9f26-8afec8aa4576 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:38:58.350535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 738/1493] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:39:07.950574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=82 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:39:08.348270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=50 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:17.282278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:17.282872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:17.282872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:17.364898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:40:17.366119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:17.467530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 756/1494] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:40:17.476274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:17.476806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:17.476806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:17.569108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:40:17.570267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:17.673310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 739/1495] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:40:17.680177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:17.681424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:17.693114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a9c85-8bef-4ed6-b920-ec92c304046c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:17.769227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:17.808733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:17.809350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:17.809632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:17.809902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:17.810713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:40:17.811027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:17.812081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:17.812081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:40:17.812081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:40:17.812979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:17.824965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 757/1496] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:40:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:40:17.833585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:17.843906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184568e1-d11d-4d7f-8929-6cf1f140d0b3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:17.909204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:17.944322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:17.944956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:17.945245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:17.945523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:17.946200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:17.948044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:17.948044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:40:17.948044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:40:17.949287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:18.011351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 740/1497] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:40:17 2022] POST /identity/v3/projects => generated 378 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:40:18.015887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:18.017423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:18.050850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965aa82-407d-47ff-91cd-f93f3a39ebd6 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:18.149453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:18.149974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:18.150258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:18.150531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:18.151200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:18.152275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:18.152275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:40:18.152275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:40:18.153497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:18.198166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 758/1498] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:40:18 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:40:18.203319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:18.205648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:18.280681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04495d6-cf85-490a-9657-b0df4505ccc6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:18.369773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:18.382191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:18.382831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:18.383119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:18.383828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:18.384619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:18.385685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:18.385685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:40:18.385685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:40:18.386586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:18.399911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 741/1499] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:40:18 2022] GET /identity/v3/roles => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:40:18.404429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:18.406077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:18.418495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991e3e-679a-4fc7-91f3-8f03f73770af admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:18.452813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:18.541413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:18.542057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:18.542330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:18.542595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:18.543302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:18.544373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:18.544373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:40:18.544373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:40:18.545520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa32a-290e-448b-8b83-56d8c1ec7a5a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:18.562403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 759/1500] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:40:18 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:40:18.567044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:18.568699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:18.614620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae22b7b-1032-4e10-bcbf-7522402c0d15 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:18.738283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:18.738979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:18.739262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:18.739578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] PATH_INFO: `/v3/projects/30c4ddd51e13453a89e41fc4d94818f0/users/c50d546f64f64756bdf88529cbd0a7a3/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:18.768403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c4ddd51e13453a89e41fc4d94818f0, user_id=c50d546f64f64756bdf88529cbd0a7a3, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:18.769479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:18.769479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:40:18.769479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:40:18.771467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba65d0-4710-4c1b-988a-2ea437ba52fe admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:18.804915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 742/1501] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:40:18 2022] PUT /identity/v3/projects/30c4ddd51e13453a89e41fc4d94818f0/users/c50d546f64f64756bdf88529cbd0a7a3/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:40:18.818919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c484a5-f954-41d6-acd4-ffde13565b19 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:18.819412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c484a5-f954-41d6-acd4-ffde13565b19 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:18.819849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c484a5-f954-41d6-acd4-ffde13565b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:18.892096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-19c484a5-f954-41d6-acd4-ffde13565b19 None None] MFA Rules not processed for user `c50d546f64f64756bdf88529cbd0a7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:40:18.893320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-19c484a5-f954-41d6-acd4-ffde13565b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:18.987771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 760/1502] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:40:19.003339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:19.003653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:19.003957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:19.005365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 743/1503] 10.222.0.100 () {54 vars in 969 bytes} [Fri Aug 5 20:40:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:40:19.010902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7fb6-9415-4320-a0bd-47add38efd8c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:19.011192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7fb6-9415-4320-a0bd-47add38efd8c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:19.011514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7fb6-9415-4320-a0bd-47add38efd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:19.049944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:19.106581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3f1e7fb6-9415-4320-a0bd-47add38efd8c None None] MFA Rules not processed for user `c2828c36b4144b0098071053b9436388`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:40:19.108189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3f1e7fb6-9415-4320-a0bd-47add38efd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:19.205992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 761/1504] 10.222.0.100 () {58 vars in 1066 bytes} [Fri Aug 5 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:40:19.218336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:19.219945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:19.282786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:19.359668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a4e2d-2ac1-423c-a5a3-fc7dda7fa7f0 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:19.462011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:19.462639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:19.462914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:19.463183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:19.464871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:19.584277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:19.585648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:19.589318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:19.605983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 744/1505] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:40:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:40:19.672735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83baba-3bbc-4ae5-91ae-9bbeabfe4368 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:19.673251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83baba-3bbc-4ae5-91ae-9bbeabfe4368 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:19.673361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83baba-3bbc-4ae5-91ae-9bbeabfe4368 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:19.674622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 762/1506] 10.222.0.100 () {52 vars in 835 bytes} [Fri Aug 5 20:40:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:40:19.678764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:19.680040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:19.790831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fa75f-9eb4-448b-93ea-8787907eb74f service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:19.889794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:19.890448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:19.890723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:19.890997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] PATH_INFO: `/v3/users/c50d546f64f64756bdf88529cbd0a7a3` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:19.904152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50d546f64f64756bdf88529cbd0a7a3)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:19.905288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:19.905288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:40:19.905288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:40:19.906507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:19.919926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:19.997129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50d546f64f64756bdf88529cbd0a7a3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:20.011390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50d546f64f64756bdf88529cbd0a7a3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:20.011957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50d546f64f64756bdf88529cbd0a7a3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:20.025493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50d546f64f64756bdf88529cbd0a7a3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:20.050316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50d546f64f64756bdf88529cbd0a7a3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:20.056470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 745/1507] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:40:19 2022] DELETE /identity/v3/users/c50d546f64f64756bdf88529cbd0a7a3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:40:20.061592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:20.061878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:20.062154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:20.121541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:40:20.122672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:20.213478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:20.233469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 763/1508] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:40:20.249544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:20.250796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:20.357023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d5b4d-e121-4677-bcfe-ca843f681969 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:20.418715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:20.449891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:20.450624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:20.450969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:20.451411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:20.453249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:20.571585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:20.573023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ed42f-7805-48cb-9d25-c939c083972b service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:20.591695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 746/1509] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:40:20.947711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:40:20.949068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:40:20.962798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238c0c3-b211-4ab0-8423-5a38cc63c14c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:40:21.062577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:40:21.063240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:40:21.063546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:40:21.063810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] PATH_INFO: `/v3/projects/30c4ddd51e13453a89e41fc4d94818f0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:40:21.074756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c4ddd51e13453a89e41fc4d94818f0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:40:21.075845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:40:21.075845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:40:21.075845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:40:21.077061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:40:21.140803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c4ddd51e13453a89e41fc4d94818f0', 'request_id': 'req-3555913d-e044-4032-9e23-0d762f53d2bd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:21.154103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c4ddd51e13453a89e41fc4d94818f0', 'request_id': 'req-3555913d-e044-4032-9e23-0d762f53d2bd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:21.162248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c4ddd51e13453a89e41fc4d94818f0', 'request_id': 'req-3555913d-e044-4032-9e23-0d762f53d2bd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:21.193548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] The token cache is being invalidate because project 30c4ddd51e13453a89e41fc4d94818f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:40:21.193775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:21.194169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3555913d-e044-4032-9e23-0d762f53d2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:40:21.195659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 764/1510] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:40:20 2022] DELETE /identity/v3/projects/30c4ddd51e13453a89e41fc4d94818f0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:40:30.589415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=62 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:40:31.191411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:41:55.647040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821a-887e-4847-9819-fbd381bd502e None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:55.647771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821a-887e-4847-9819-fbd381bd502e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:55.647771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821a-887e-4847-9819-fbd381bd502e None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:55.649125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:41:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:41:55.654384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ebc8-eb18-4c28-a21e-51d36291e37d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:55.654839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ebc8-eb18-4c28-a21e-51d36291e37d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:55.654974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ebc8-eb18-4c28-a21e-51d36291e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:55.745764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-63e6ebc8-eb18-4c28-a21e-51d36291e37d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:41:55.746984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-63e6ebc8-eb18-4c28-a21e-51d36291e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:41:55.858253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:41:56.018275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d821a-887e-4847-9819-fbd381bd502e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:41:56.021486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-492d821a-887e-4847-9819-fbd381bd502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:41:56.152572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d821a-887e-4847-9819-fbd381bd502e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:41:56.158992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:41:56.159709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:56.160006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:56.160281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:56.169960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:41:56.171580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f47fb-935c-4bbc-a144-b31fba1f25f7 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:41:56.182072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 748/1513] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:41:56 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:41:57.023612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c73b2-a689-479f-bbfa-6159f195595b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:57.024229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c73b2-a689-479f-bbfa-6159f195595b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:57.024229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c73b2-a689-479f-bbfa-6159f195595b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:57.026140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:41:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:41:57.031575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743630c-4dbe-4242-bdcb-5a2a0af249a3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:57.032003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743630c-4dbe-4242-bdcb-5a2a0af249a3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:57.032093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743630c-4dbe-4242-bdcb-5a2a0af249a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:57.055787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d743630c-4dbe-4242-bdcb-5a2a0af249a3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:41:57.057006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d743630c-4dbe-4242-bdcb-5a2a0af249a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:41:57.065737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:41:57.224960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c73b2-a689-479f-bbfa-6159f195595b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:41:57.251097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c73b2-a689-479f-bbfa-6159f195595b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:41:57.259875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:41:57.260497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:57.260786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:57.261057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:57.270240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:41:57.271932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780907-1134-47f5-be89-456fb76da3ab service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:41:57.285085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 767/1516] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:41:57.413527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae05bf-fcf5-409c-9ac7-34e960012e2d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:57.413960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae05bf-fcf5-409c-9ac7-34e960012e2d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:57.414385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae05bf-fcf5-409c-9ac7-34e960012e2d None None] PATH_INFO: `/v3` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:57.416478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 750/1517] 10.222.0.121 () {54 vars in 930 bytes} [Fri Aug 5 20:41:57 2022] GET /identity/v3 => generated 256 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:41:57.432225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56698-67a7-4b0e-8595-4037408ca8aa None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:41:57.432523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56698-67a7-4b0e-8595-4037408ca8aa None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:41:57.432856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a56698-67a7-4b0e-8595-4037408ca8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:41:57.504430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-36a56698-67a7-4b0e-8595-4037408ca8aa None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:41:57.505628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-36a56698-67a7-4b0e-8595-4037408ca8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:41:57.524260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:41:57.581108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 768/1518] 10.222.0.121 () {58 vars in 1020 bytes} [Fri Aug 5 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:42:01.506515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177f5-1802-4576-90ab-83133ca1b13e None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:01.507044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177f5-1802-4576-90ab-83133ca1b13e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:01.507044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735177f5-1802-4576-90ab-83133ca1b13e None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:01.508393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 751/1519] 10.222.0.100 () {54 vars in 966 bytes} [Fri Aug 5 20:42:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:01.513585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dd0-a72c-46d1-87ef-7b8a84909d2c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:01.514025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dd0-a72c-46d1-87ef-7b8a84909d2c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:01.514130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f1dd0-a72c-46d1-87ef-7b8a84909d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:01.535573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-125f1dd0-a72c-46d1-87ef-7b8a84909d2c None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:01.536871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-125f1dd0-a72c-46d1-87ef-7b8a84909d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:01.546404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 769/1520] 10.222.0.100 () {58 vars in 1063 bytes} [Fri Aug 5 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:42:01.553994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735177f5-1802-4576-90ab-83133ca1b13e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:01.569041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735177f5-1802-4576-90ab-83133ca1b13e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:01.574998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:01.575696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:01.575978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:01.576254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:01.585085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:01.586699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d6982-12bd-404b-932c-95178ec0f6c1 service placement] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:01.596762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 752/1521] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:01 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:08.520429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891cbf-bbc2-481d-84a7-f2432556c66c None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:08.521380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891cbf-bbc2-481d-84a7-f2432556c66c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:08.521380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891cbf-bbc2-481d-84a7-f2432556c66c None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:08.523201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:42:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:08.528211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961b0c-0a78-4d11-b7f3-acee4c0ea793 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:08.528657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961b0c-0a78-4d11-b7f3-acee4c0ea793 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:08.528757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961b0c-0a78-4d11-b7f3-acee4c0ea793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:08.550459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e6961b0c-0a78-4d11-b7f3-acee4c0ea793 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:08.551713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e6961b0c-0a78-4d11-b7f3-acee4c0ea793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:08.561687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:42:08.716506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891cbf-bbc2-481d-84a7-f2432556c66c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:08.732954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891cbf-bbc2-481d-84a7-f2432556c66c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:08.739204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:08.739858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:08.740166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:08.740445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:08.749207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:08.750830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118d83c-d316-48dc-b14a-ab005c490b95 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:08.760620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 771/1524] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:09.591587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4493fa9-5c9d-4afe-8dad-3663684873ed None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:09.592686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4493fa9-5c9d-4afe-8dad-3663684873ed None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:09.592686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4493fa9-5c9d-4afe-8dad-3663684873ed None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:09.594623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 20:42:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:09.603028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dee43-70c9-47a0-befd-0136ce0b2bc2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:09.603522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dee43-70c9-47a0-befd-0136ce0b2bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:09.603625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dee43-70c9-47a0-befd-0136ce0b2bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:09.632188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b35dee43-70c9-47a0-befd-0136ce0b2bc2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:09.633379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b35dee43-70c9-47a0-befd-0136ce0b2bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:09.643293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:42:09.800227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4493fa9-5c9d-4afe-8dad-3663684873ed None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:09.824202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4493fa9-5c9d-4afe-8dad-3663684873ed None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:09.831086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:09.831759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:09.832050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:09.832329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:09.841537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:09.843203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f2f13-b87c-4f8f-af50-04b0be91ad82 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:09.853485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 755/1527] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:13.836263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:13.837038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:13.837396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:13.839652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:42:13 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:13.847694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d24be-29bd-46a7-b843-febac65153e8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:13.848168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d24be-29bd-46a7-b843-febac65153e8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:13.848278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d24be-29bd-46a7-b843-febac65153e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:13.873237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9f6d24be-29bd-46a7-b843-febac65153e8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:13.874503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9f6d24be-29bd-46a7-b843-febac65153e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:13.884353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:42:13.964513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:13.966585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:14.059808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aba31-77cf-44e9-aa9e-f3c99aae6544 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:14.064014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:14.064645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:14.064915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:14.065181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:14.075616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:14.077090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfaa5c-0e5d-4d5f-a1b0-a30b9192dae3 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:14.088296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 774/1530] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:16.086619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c43c8-d553-42b2-8702-149066142a52 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:16.087194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c43c8-d553-42b2-8702-149066142a52 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:16.087194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c43c8-d553-42b2-8702-149066142a52 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:16.089377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:42:16 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:16.097243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ebb62-fcaf-41c0-b087-5cd21f41864a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:16.097735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ebb62-fcaf-41c0-b087-5cd21f41864a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:16.097841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ebb62-fcaf-41c0-b087-5cd21f41864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:16.119010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4e6ebb62-fcaf-41c0-b087-5cd21f41864a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:16.120282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4e6ebb62-fcaf-41c0-b087-5cd21f41864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:16.128467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:42:16.169522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c43c8-d553-42b2-8702-149066142a52 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:16.171734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-818c43c8-d553-42b2-8702-149066142a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:16.186657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c43c8-d553-42b2-8702-149066142a52 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:16.190966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:16.191638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:16.191931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:16.192208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:16.203046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:16.204571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47037c94-686a-43bf-9b4f-6106536c7e7a service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:16.215067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 758/1533] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:19.716830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:19.717477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:19.717477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:19.718825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:42:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:19.724558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce1f-000d-4726-b5f6-1f5bb54addd5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:19.725085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce1f-000d-4726-b5f6-1f5bb54addd5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:19.725251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138ce1f-000d-4726-b5f6-1f5bb54addd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:19.754659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-5138ce1f-000d-4726-b5f6-1f5bb54addd5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:19.757533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5138ce1f-000d-4726-b5f6-1f5bb54addd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:19.775158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:42:20.126387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:20.128492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:20.214380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:20.237844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c821d57-bd19-4dda-948d-7521d2f1c124 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:20.244195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:20.245221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:20.245686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:20.246150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:20.258399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:20.263925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2f8ba-6350-46b5-8706-e28796b721ff service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:20.274401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 777/1536] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:22.338013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:22.338859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:22.338859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:22.341183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 20:42:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:42:22.347437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d5a4-f772-4d37-b913-0ad26c20f17f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:22.347844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d5a4-f772-4d37-b913-0ad26c20f17f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:22.347990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d5a4-f772-4d37-b913-0ad26c20f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:22.375516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9ab9d5a4-f772-4d37-b913-0ad26c20f17f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:42:22.376725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9ab9d5a4-f772-4d37-b913-0ad26c20f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:22.386096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:42:22.704331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:42:22.707587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:42:22.722875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=84 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:22.733877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c7ae6-6b02-4cea-886c-3f2d7a123639 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:42:22.741022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:42:22.741713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:42:22.741995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:42:22.742276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:42:22.752412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:42:22.753866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccf86d-557b-4c4d-9dfa-fecc3dee6b30 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:42:22.765019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 761/1539] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:42:32.370544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=11 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:32.761048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:48.294841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.296004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.296513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.327907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:48.329506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:48.340579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 779/1540] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:48.352088 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912fc3-656b-48de-89eb-49329c801ede None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.353732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912fc3-656b-48de-89eb-49329c801ede None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.354395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912fc3-656b-48de-89eb-49329c801ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.408398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1f912fc3-656b-48de-89eb-49329c801ede None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:48.410886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1f912fc3-656b-48de-89eb-49329c801ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:48.432201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 762/1541] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:48.438348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.449717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff0a-fe1c-4664-9fc7-0848c5772006 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.450180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff0a-fe1c-4664-9fc7-0848c5772006 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.450668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff0a-fe1c-4664-9fc7-0848c5772006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.468437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960fab-5416-4b25-98a7-78a66a400a98 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:48.484527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:48.486023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.487253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.488098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.489532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:48.490251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:48.493943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:48.500692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-461eff0a-fe1c-4664-9fc7-0848c5772006 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:48.502386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-461eff0a-fe1c-4664-9fc7-0848c5772006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:48.529255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 763/1542] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:48.538464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 780/1543] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:48.547223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.547476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.547940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.548378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.572271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760f7d-e75a-4528-839d-1cc876e80599 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:48.587638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:48.589142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:48.590549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:48.592311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.592819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.593328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.595170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:48.597380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:43:48.597380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:43:48.597380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:43:48.600980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:48.603498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 764/1544] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:48.616140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.627993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373938-b9ec-4a5e-aa16-57666c352395 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:48.644148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:48.645107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.645700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.646139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.647033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:48.647522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:48.649201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:43:48.649201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:43:48.649201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:43:48.650456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:48.675749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 765/1545] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:43:48.684467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.700878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108163c-59fb-45e2-9ff1-eb4d1dbb7887 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:48.712389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:48.713342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.713798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.714236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.714425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 781/1546] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/projects => generated 374 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:48.715233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:48.717340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d761b-b64e-483e-a003-4ad98509e563 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:48.723391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.770892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 766/1547] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/projects => generated 384 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:48.776442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.776980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.777424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.816618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:48.818384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:48.948651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd62142-86de-4cce-9ad5-d56f833c6fb8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:48.968404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:48.969351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:48.969800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:48.972900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 767/1548] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:48.973996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:48.975285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:48.976604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:48.987822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf51b9-b432-480d-bc0e-c38393d388e0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.016438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675e7b-4aab-47c1-ad52-5aa199396fa2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.043794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.044930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.045400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.045890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.053773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.058657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 782/1549] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:43:49.059123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:43:49.059123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:43:49.059123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:43:49.060033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.060321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.060597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.061537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22176b0-ed05-4807-b89b-1d3765056ef9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.113061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.114505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.132566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 768/1550] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:48 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:49.137842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 783/1551] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.138631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.138923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.139593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.140084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.161849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd136a-0b5d-4841-8a1e-8dca12ac17ea None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.185325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.185973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.186251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.186520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.187423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.189045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9a5a3-1517-4237-87be-b57f0a63f7dd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.196486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.196486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.206529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 784/1552] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:49.208505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901d03-3dc0-424d-8915-729a77b04073 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.210319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901d03-3dc0-424d-8915-729a77b04073 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.211535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901d03-3dc0-424d-8915-729a77b04073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.214183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 769/1553] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.215351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.227604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca2b7-37f5-4e53-a502-934172c22ad6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.242225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.243281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.243798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.244294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.245591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.250149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd425fe-4605-40ba-b3b4-ed3301aa8ded admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.251798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6e901d03-3dc0-424d-8915-729a77b04073 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.253396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6e901d03-3dc0-424d-8915-729a77b04073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.262290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 785/1554] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.267403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 770/1555] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:49.267588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.267588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.267771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.267847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.267933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.267933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.284635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.285861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.286252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.287503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.294418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 786/1556] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.295340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.297353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 771/1557] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.298720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.309592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f6c1-e77e-4b20-b449-e9d5768f5f4e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.310035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cc40e-7772-409e-a4ad-535c4c21b078 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.314287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.314917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.315055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.315186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.315643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.315783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.315913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.316232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.316367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.317039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.317352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.317986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5441-8388-4c72-ac3e-3bce25aad961 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.318964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e3667-e465-499c-972f-0617de7bff01 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.328651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 787/1558] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:49.330197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367bc-b97c-417b-aa5c-1871c6c74ad2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.330671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367bc-b97c-417b-aa5c-1871c6c74ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.331029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367bc-b97c-417b-aa5c-1871c6c74ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.331582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 772/1559] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.332887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.333187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.333472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.357752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.358674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-eda367bc-b97c-417b-aa5c-1871c6c74ad2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.358983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.359907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eda367bc-b97c-417b-aa5c-1871c6c74ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.367852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 773/1560] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.371556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 788/1561] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.371758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.371877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.371877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.371877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.382624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2631343-a11e-4a2e-b033-bf98f4d8d50a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.387563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.388191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.388487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.388746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.389460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.391528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608ba65-e05b-4422-9ef0-23091da0ef34 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.392234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.393460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.402015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 789/1562] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.402348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 774/1563] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:49.406302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.406447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.406447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.406447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.415945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c422b8a-1ede-4351-a990-dd70f36a91a9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.421010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.421552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.421834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.422109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.422844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.423152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.424844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.426107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.427040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.436001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 775/1564] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.436622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.437380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 790/1565] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.438186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.449579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eb1da-dd3e-4223-a05b-252a6bcfacb8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.450369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9f54-7364-40f3-a636-e5bb9ebaec4a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.454450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.455089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.455245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.455428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.455715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] PATH_INFO: `/v3/projects/0f42e5cd81d449efba58439d05cc0e59/users/9e882fe2f76f4d2a806f2438c492ae0d/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.455812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.456029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.456285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.456954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.458883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895585e-e7c3-40c1-bf6c-acfa7d548052 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.472411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f42e5cd81d449efba58439d05cc0e59, user_id=9e882fe2f76f4d2a806f2438c492ae0d, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.475104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade60201-5379-4078-9214-c86e31950ac1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.507177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 791/1566] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/projects => generated 368 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:49.507463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 776/1567] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:49 2022] PUT /identity/v3/projects/0f42e5cd81d449efba58439d05cc0e59/users/9e882fe2f76f4d2a806f2438c492ae0d/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:49.507576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.507576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.507576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.507903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.507903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.507903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.507903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.518950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.519311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.520271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.520547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.526434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.584711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 777/1568] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.585858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.595289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 792/1569] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.596474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200624dd-627f-4068-adb7-c86ad7c42b08 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.596628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.602959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.603644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.603925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.604194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.604898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.605201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.606902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca414383-72cd-47f3-ab88-5b175e00a6fd None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.607060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.612192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.612957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.613104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.613331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] PATH_INFO: `/v3/projects/8b67138a484f481099c562d7e3ca8401/users/8e1baad75342476aa0c64bda0414e334/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.622512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 778/1570] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.623494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.630678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b67138a484f481099c562d7e3ca8401, user_id=8e1baad75342476aa0c64bda0414e334, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.631829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:43:49.631829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:43:49.631829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:43:49.634485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.636931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc4d2-7215-409f-968b-10f4571345e5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.642253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.642896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.643174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.643478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.644186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.644487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.646091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.651911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 793/1571] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:49 2022] PUT /identity/v3/projects/8b67138a484f481099c562d7e3ca8401/users/8e1baad75342476aa0c64bda0414e334/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:49.652117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.664515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 779/1572] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.664515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.671883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888684d7-210a-4b09-a435-f8048e4a2928 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.733527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.734392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.734690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.734949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.735654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.738567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cea01-1e1d-4e29-bfc9-f54c13dd10e8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.738755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a259-4ebf-4559-bc9d-d654c9feba01 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.742995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.743757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.744139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.744485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.745290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.747288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.769506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 780/1573] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:49.771236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.771573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.771858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.784594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 794/1574] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/projects => generated 374 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:49.785456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.803471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] MFA Rules not processed for user `9e882fe2f76f4d2a806f2438c492ae0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.804826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:49.856282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e580-bb75-4a8b-bd17-42d6d5989faf admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.861474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.862104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.862389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.862665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.863376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.863698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.865190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.865322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.881080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 781/1575] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:49.881080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.881356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 795/1576] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.881356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.890301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.895798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe199-d722-4235-941b-af5c31ab0a8d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.897801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385d00f-1e00-413d-8eea-57063cd7a804 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:49.903602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.904073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:49.904703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.904949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.905440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.906181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.908519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.911336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.911642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.911938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.912631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:49.912933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:49.914805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54f427-d06b-49e8-98f7-86ccd4288b4f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:49.935006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 782/1577] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:49.935006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:49.935006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:49.935006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:49.946123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 796/1578] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/projects => generated 388 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:49.947382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:49.950289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:49.951539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:50.016352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d627d-9b3a-4309-a77e-7686293d1395 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.020986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.021214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 783/1579] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:50.021623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.021910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.022147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.022256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.022881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.025401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.033202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729c2a-2581-4bab-a110-0f429b5f197b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.038051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.038825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.039211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.039889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.040094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.041704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.056264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 784/1580] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.056264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.056795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 797/1581] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:49 2022] POST /identity/v3/projects => generated 378 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.057997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.066019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477be8b-0c44-42a6-ae8e-4bb937bda24b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.126519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.127165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.127559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.127869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.128525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.130653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef085d0-02d4-4d81-82ec-a2203a829425 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.132054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cdd5-2a78-4240-85b3-09d4d14005d9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.139195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.139858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.140305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.140587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.141267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.143212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.156533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 785/1582] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.158196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bdeb9-a97f-448f-83f2-954f65082f7b None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.158514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bdeb9-a97f-448f-83f2-954f65082f7b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.158794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bdeb9-a97f-448f-83f2-954f65082f7b None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.160188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 786/1583] 10.222.0.100 () {54 vars in 967 bytes} [Fri Aug 5 20:43:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:43:50.160738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bdeb9-a97f-448f-83f2-954f65082f7b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.176723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bdeb9-a97f-448f-83f2-954f65082f7b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.180783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 798/1584] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/projects => generated 380 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.181683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.186479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.187352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.187745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.188536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.189205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.191146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.221618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 787/1585] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/projects => generated 408 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.222280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.240013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:50.251732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7246b-5a5f-4ad0-b506-6aa8f7b269f2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.267603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:50.283619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28627e68-bc4f-4182-982a-435c4ed515be admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.287318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.287979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.288265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.288617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.314203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.315939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.316221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.316499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.317180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.319303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.343726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 799/1586] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.344687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.356294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdbe1-eb3f-4860-87f1-fa5959cefeda admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.357797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.359249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.361097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.361724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.362006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.362281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.362993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.364633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.369529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 788/1587] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:50.370511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.379271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 800/1588] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.379271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.380628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5920648-8300-40f4-93e2-d6277fdcf07e service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.385689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.386797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.386797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.387101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.387942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.389869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17e7dc-074f-43b0-b336-099bbc609055 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.393156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6ec8-d1f9-4620-9dd3-c3f93d770fff admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.399160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.400206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.400570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.401352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.403081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.404988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.416288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 789/1589] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.417558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.417847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.418120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.420750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 801/1590] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.421421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.431920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7448-1b98-47df-92c3-82d1fb463bb5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.436829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.437465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.437744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.438014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.438680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.440691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.466849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 802/1591] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.467155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:50.467666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.468353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:50.480502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e16f-c4bb-44ee-99a0-a907e322c3f5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.488074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.488754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.489080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.489359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.490043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.492669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.520292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 803/1592] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/users => generated 305 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:50.521329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.533984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7dd1-12cd-46ea-9789-23ee15a253ff admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.540427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.541074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.541472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.541745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.542572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.544417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.557904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 790/1593] 10.222.0.100 () {58 vars in 1064 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:50.558689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.565743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 804/1594] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.566462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.578834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3ef1-5553-4af3-8109-97709d25d9b4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.581108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4310a-4dc0-4f01-9439-09e8236c7f97 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.584099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.584714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.584999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.585270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] PATH_INFO: `/v3/projects/d8f52d460eea4e87be00d2f9712f0867/users/c54a4bb45ba247c9ae4650c0c520f803/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.589364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.590130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.590501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.590983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.591962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.593807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.604534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f52d460eea4e87be00d2f9712f0867, user_id=c54a4bb45ba247c9ae4650c0c520f803, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.609836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 805/1595] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.610051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.610177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.622122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293d7c-9a43-4ebf-9dc7-7f09f8cb256d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.625362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 791/1596] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:50 2022] PUT /identity/v3/projects/d8f52d460eea4e87be00d2f9712f0867/users/c54a4bb45ba247c9ae4650c0c520f803/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:50.632931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.665408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:50.704321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.704980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.705257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.705527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.706457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.708163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.713626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b67d-f7c3-4423-9865-734d47ee0572 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.718466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.719101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.719400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.719848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 806/1597] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.720770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.722798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.723590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.725323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.743927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 792/1598] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.744142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021429df-958d-4073-8e8f-650679ef5d2c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.744245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.748679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.749392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.750249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.750249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.750894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.753009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.754952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:50.768461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 807/1599] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.769549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.785746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45a1e-3140-4656-9026-d684e94d841a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.791840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.792602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.793142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.793429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.794145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.796010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.808852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 808/1600] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.810148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.821461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216ab7-1d7e-431e-8154-341c46fd9124 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.828667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.829750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.830311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.830813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.831970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.833880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af5c5e-cd22-4679-b4fe-655927c461af admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.846161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 809/1601] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:50.846731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e56ee-844d-4039-b81c-4341ca19b547 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.848084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.848549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.848969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.855250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.856102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.856456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.856804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:50.887140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] MFA Rules not processed for user `c54a4bb45ba247c9ae4650c0c520f803`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:50.889081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:50.940384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:50.942137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:50.954934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 793/1602] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:50.955899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:50.971729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd0f0-3ae9-426e-8db5-df1a17e2191d service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:50.978104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:50.979036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:50.979584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:50.980157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] PATH_INFO: `/v3/projects/536cdbe85a4548b4ab38deeb771c920c/users/75ce73cad1614c5fa96b7e95b36326e0/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.001425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536cdbe85a4548b4ab38deeb771c920c, user_id=75ce73cad1614c5fa96b7e95b36326e0, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.002342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 810/1603] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:51.004182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.004873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.021722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221975d9-6dd4-474f-94e4-9699534855d6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.032408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 794/1604] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:50 2022] PUT /identity/v3/projects/536cdbe85a4548b4ab38deeb771c920c/users/75ce73cad1614c5fa96b7e95b36326e0/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:51.033412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.082338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.102116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.102919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.103303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.103714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.104575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.106303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.118806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 811/1605] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:51 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:51.120590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.125589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656223b6-1e6f-496b-ab94-844f32615d93 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.134921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.135399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.135768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.136059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.137189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.138771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927915-a5c4-4edf-b8d3-043e2d3977c7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.139004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.147469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.148510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.149004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.149515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] PATH_INFO: `/v3/projects/c687166988fc4513a81e536a8f38ca3e/users/44ac4775be0244df8fa0ee51a765c03a/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.162293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 795/1606] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:51 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:51.164734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.173705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c687166988fc4513a81e536a8f38ca3e, user_id=44ac4775be0244df8fa0ee51a765c03a, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.177511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.203830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 812/1607] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:51 2022] PUT /identity/v3/projects/c687166988fc4513a81e536a8f38ca3e/users/44ac4775be0244df8fa0ee51a765c03a/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:51.209226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.215058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875f82b-a797-4848-8797-14caab9f7087 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.292954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.319228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.320300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.320597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.320927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] PATH_INFO: `/v3/projects/2ae12b8f8a7f40758ca0edaeea7022ab/users/396a79cbb4e9494791422713c596bc0c/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.323853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70340-3860-44f3-a5ab-3d8a93bd98a0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.330716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.331412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.331702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.331976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.346255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae12b8f8a7f40758ca0edaeea7022ab, user_id=396a79cbb4e9494791422713c596bc0c, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.351685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6526-a08c-42f1-8fa1-0e54f552c6f3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.379454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 796/1608] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:51 2022] PUT /identity/v3/projects/2ae12b8f8a7f40758ca0edaeea7022ab/users/396a79cbb4e9494791422713c596bc0c/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:51.382605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.382899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.383174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.420637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] MFA Rules not processed for user `75ce73cad1614c5fa96b7e95b36326e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.422056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:51.429606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.431629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.452850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 813/1609] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:51.455808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.493470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ba87-aa0a-4aa6-aea8-2297cd4a4b05 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.532571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 797/1610] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:51.535003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:51.625020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.625898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.626920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.627312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] PATH_INFO: `/v3/projects/46c32ca23c17400fb5388a652efacc54/users/4dc2f277a1d04094a77c6a0c90420f4a/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.645464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.673252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c32ca23c17400fb5388a652efacc54, user_id=4dc2f277a1d04094a77c6a0c90420f4a, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.674374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47bfe-4198-4a57-b523-5bc20f9ec34b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:51.678811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3efa1-879a-4e87-a86f-2012b69a4f54 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.680786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:51.681594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.681977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.682369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] PATH_INFO: `/v3/projects/1ca919e1b2804871bdfab9882085f05f/users/cfbf451f436b4956ae724ed1f3735cec/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.702855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca919e1b2804871bdfab9882085f05f, user_id=cfbf451f436b4956ae724ed1f3735cec, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:51.705924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d9c54-64d3-48b9-978b-8a0f112507f4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:51.710504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 814/1611] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:51 2022] PUT /identity/v3/projects/46c32ca23c17400fb5388a652efacc54/users/4dc2f277a1d04094a77c6a0c90420f4a/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:51.712317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ed66-3b21-438e-b4b8-d4c40e6cd505 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.714652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ed66-3b21-438e-b4b8-d4c40e6cd505 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.715559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ed66-3b21-438e-b4b8-d4c40e6cd505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.739893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 798/1612] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:51 2022] PUT /identity/v3/projects/1ca919e1b2804871bdfab9882085f05f/users/cfbf451f436b4956ae724ed1f3735cec/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:51.743195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04381-ee08-4c1d-b18e-a6c9aec13d74 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.743536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04381-ee08-4c1d-b18e-a6c9aec13d74 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.745392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04381-ee08-4c1d-b18e-a6c9aec13d74 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.747168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 799/1613] 10.222.0.100 () {54 vars in 917 bytes} [Fri Aug 5 20:43:51 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:43:51.748461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c395-e602-47eb-abaa-a6c9f655e9a4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.748754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c395-e602-47eb-abaa-a6c9f655e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.749009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c395-e602-47eb-abaa-a6c9f655e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.759492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3de9ed66-3b21-438e-b4b8-d4c40e6cd505 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.760972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3de9ed66-3b21-438e-b4b8-d4c40e6cd505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:51.787089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7603c395-e602-47eb-abaa-a6c9f655e9a4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.789309 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7603c395-e602-47eb-abaa-a6c9f655e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:51.855989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 815/1614] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:51.862556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ee4a6-a477-4231-9a3c-4d05721eb726 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.863123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ee4a6-a477-4231-9a3c-4d05721eb726 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.863476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ee4a6-a477-4231-9a3c-4d05721eb726 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.866212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 816/1615] 10.222.0.100 () {54 vars in 967 bytes} [Fri Aug 5 20:43:51 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:43:51.867658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634dcbf-fa26-43bf-b00b-6c5eccebff29 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.868002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634dcbf-fa26-43bf-b00b-6c5eccebff29 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.868336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634dcbf-fa26-43bf-b00b-6c5eccebff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.888197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 800/1616] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:51.889880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa13f4-d04a-477f-8d6f-6765c2301d24 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.890272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa13f4-d04a-477f-8d6f-6765c2301d24 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.890663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa13f4-d04a-477f-8d6f-6765c2301d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.915716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9634dcbf-fa26-43bf-b00b-6c5eccebff29 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.918113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9634dcbf-fa26-43bf-b00b-6c5eccebff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:51.929804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8afa13f4-d04a-477f-8d6f-6765c2301d24 None None] MFA Rules not processed for user `cfbf451f436b4956ae724ed1f3735cec`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.931334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8afa13f4-d04a-477f-8d6f-6765c2301d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:51.939883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 817/1617] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:51.953404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:51.954021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:51.954459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:51.979626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.988678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:51.990682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:52.054778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 801/1618] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:52.054778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.054778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.054778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.101139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:52.103463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:52.106079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 818/1619] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:52.107046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.118261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 802/1620] 10.222.0.100 () {58 vars in 1064 bytes} [Fri Aug 5 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:52.121438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.243962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3df6-d221-4225-8fa5-adf4c44b2830 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.252332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.253125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.253407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.253681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.254425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75e14-52d2-498c-b952-9b80849d2af6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.262170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.262828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.263111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.263448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.277175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.278658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.284515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:52.293473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.298528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.312600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 819/1621] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:52.314126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.328745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a166c-2363-4365-89b4-eacd0674f9da service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.334943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.336133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.336681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.337281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.350167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 803/1622] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:52.351623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.351859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.354731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.381483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d81c25-009a-440e-97c1-6b059f3f84be service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.386451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 820/1623] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:52.387411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.393553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.394936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.395703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.396395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.397960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.402247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.485236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 804/1624] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:52 2022] POST /identity/v3/projects => generated 406 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:52.486407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.558878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133caa60-fd36-4872-88fc-599d93a5bb56 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.598863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0338867-9fed-4069-8ffc-8c13c266d1fd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.607450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.608282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.608559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.608926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.650687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:52.664575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.666609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.666609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.666992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.694580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.698695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.725363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 821/1625] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:52.726214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.729921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.794367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.794367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 805/1626] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:52.908638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9fcd5-77bf-457e-8f1a-d66fd1a6c5e6 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:52.916498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:52.917303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:52.917670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:52.917941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:52.918755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:52.921537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:52.965668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 822/1627] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:52 2022] POST /identity/v3/users => generated 310 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:52.969212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:52.988943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff049-3e4a-4633-a1b1-82a645b48d3a service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.008603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.009591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.009980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.010383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.011218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.013024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:53.044829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 806/1628] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:52 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:53.046044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:53.061474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2c31-5093-43f6-905a-594cac5b559b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.079256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.080014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.080299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.080636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] PATH_INFO: `/v3/projects/8db087b9ccc344e089a66aea885a6058/users/d77535dcc43540cc9d1ad38459fd593b/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.109720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db087b9ccc344e089a66aea885a6058, user_id=d77535dcc43540cc9d1ad38459fd593b, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.113318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09510-2889-4f1f-b063-91e327d0af0d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:53.137518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 823/1629] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:53 2022] PUT /identity/v3/projects/8db087b9ccc344e089a66aea885a6058/users/d77535dcc43540cc9d1ad38459fd593b/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:53.141558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:53.161108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901e57-2987-4f35-8a24-39140d5a691e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.310836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255eaac-28e8-4eb1-a312-0189117eb6ae None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.311199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255eaac-28e8-4eb1-a312-0189117eb6ae None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.312486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255eaac-28e8-4eb1-a312-0189117eb6ae None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.314566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 824/1630] 10.222.0.100 () {54 vars in 917 bytes} [Fri Aug 5 20:43:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:43:53.321188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.322022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.322022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.335332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:53.358749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.360207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.360503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.360781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.361592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.364869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:53.369076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:53.370220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:53.396525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 807/1631] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:53 2022] GET /identity/v3/roles => generated 1427 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:53.397467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:53.411022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917630b5-f93c-4304-a4d5-e789d598e833 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.418272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.419663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.421759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.422195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] PATH_INFO: `/v3/projects/8db087b9ccc344e089a66aea885a6058/users/d77535dcc43540cc9d1ad38459fd593b/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.426414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db087b9ccc344e089a66aea885a6058, user_id=d77535dcc43540cc9d1ad38459fd593b, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.430590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af508aba-a459-4d46-9085-5c349c3f2e71 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:53.455730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 808/1632] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:53 2022] PUT /identity/v3/projects/8db087b9ccc344e089a66aea885a6058/users/d77535dcc43540cc9d1ad38459fd593b/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:53.473094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae866-932d-4126-9861-ea334d523c43 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.473387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae866-932d-4126-9861-ea334d523c43 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.473674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae866-932d-4126-9861-ea334d523c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.506667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-91aae866-932d-4126-9861-ea334d523c43 None None] MFA Rules not processed for user `d77535dcc43540cc9d1ad38459fd593b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:53.508260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-91aae866-932d-4126-9861-ea334d523c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:53.542838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 825/1633] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:53.550489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:53.666502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:53.691242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f6ed-b645-4fb7-84ac-df8a78a99ec4 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.696499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 809/1634] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:53.762533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae866-932d-4126-9861-ea334d523c43 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:53.821097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.821824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.822220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.822564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.885682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae866-932d-4126-9861-ea334d523c43 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:53.892225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:53.893420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:53.893914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:53.894357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:53.937007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.942966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:53.971621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 810/1635] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:53.988409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:53.990097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:54.032858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 826/1636] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:54.495465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:54.511516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a0d-4c41-4b71-a729-12cf4384457e service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:54.527971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:54.530689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:54.531046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:54.531258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:54.645968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:54.704293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:54.706003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccadb05-f7a4-46c2-bed5-7eec202b16eb service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:54.734504 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 811/1637] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:54 2022] GET /identity/v3/auth/tokens => generated 3294 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:54.817903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f460f-c514-4d4f-b28b-edec577bd628 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:54.828784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:54.829458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:54.829740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:54.830018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] PATH_INFO: `/v3/users/75ce73cad1614c5fa96b7e95b36326e0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:54.834304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ce73cad1614c5fa96b7e95b36326e0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:54.843517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: WARNING py.warnings [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:43:54.843517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: warnings.warn(msg) Aug 05 20:43:54.843517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: Aug 05 20:43:54.845128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:54.952151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:54.961933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ce73cad1614c5fa96b7e95b36326e0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:54.962478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ce73cad1614c5fa96b7e95b36326e0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:54.963167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ce73cad1614c5fa96b7e95b36326e0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:54.982403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ce73cad1614c5fa96b7e95b36326e0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:55.000209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ce73cad1614c5fa96b7e95b36326e0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:55.045538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 827/1638] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:43:54 2022] DELETE /identity/v3/users/75ce73cad1614c5fa96b7e95b36326e0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:55.049857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:55.050136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:55.050658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:55.065488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:55.075516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:55.077967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:55.204047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 812/1639] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:55.232895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:55.242249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:55.446650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252d1a7-079b-47ea-8117-46e75dfa130d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:55.460349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:55.461087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:55.461531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:55.461821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:55.487338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:55.489586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c247c-684e-44b5-89ba-775c1ef6686f service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:55.519457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 828/1640] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:56.089175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:56.090407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:56.107925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9fa87-0c8a-4529-847b-14ded235443c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:56.118319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:56.121290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:56.121584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:56.121864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] PATH_INFO: `/v3/users/9e882fe2f76f4d2a806f2438c492ae0d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:56.123659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e882fe2f76f4d2a806f2438c492ae0d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:56.126741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:56.233742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e882fe2f76f4d2a806f2438c492ae0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:56.251615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e882fe2f76f4d2a806f2438c492ae0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:56.252410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e882fe2f76f4d2a806f2438c492ae0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:56.263307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e882fe2f76f4d2a806f2438c492ae0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:56.293623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e882fe2f76f4d2a806f2438c492ae0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:56.309641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 813/1641] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:43:56 2022] DELETE /identity/v3/users/9e882fe2f76f4d2a806f2438c492ae0d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:56.311332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:56.311876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:56.312019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:56.347770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:56.350600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:56.510280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 829/1642] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:56.565678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:56.567204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:56.689355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186b1a-5c70-4b52-81f1-22f1ba0587f6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:56.695938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:56.696602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:56.696883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:56.697167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:56.721143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:56.723397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fed26-ac99-4061-a004-96ddb99a7f5b service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:56.745329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 814/1643] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:43:56 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:43:57.368222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:57.370783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:57.385801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acee80-62be-4d80-98e7-ddabf8fc3536 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:57.392624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:57.393592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:57.395137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:57.395652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] PATH_INFO: `/v3/projects/536cdbe85a4548b4ab38deeb771c920c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:57.397227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=536cdbe85a4548b4ab38deeb771c920c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:57.399921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:57.510483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536cdbe85a4548b4ab38deeb771c920c', 'request_id': 'req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.519442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536cdbe85a4548b4ab38deeb771c920c', 'request_id': 'req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.524902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:57.527982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536cdbe85a4548b4ab38deeb771c920c', 'request_id': 'req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.556529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] The token cache is being invalidate because project 536cdbe85a4548b4ab38deeb771c920c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:43:57.556987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.561256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.563740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 830/1644] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:43:57 2022] DELETE /identity/v3/projects/536cdbe85a4548b4ab38deeb771c920c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:57.569209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a331f-251c-44dd-a46b-93404b0733cc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:57.570273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a331f-251c-44dd-a46b-93404b0733cc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:57.570741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a331f-251c-44dd-a46b-93404b0733cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:57.619089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-654a331f-251c-44dd-a46b-93404b0733cc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:57.623595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-654a331f-251c-44dd-a46b-93404b0733cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:57.682076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:57.742753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:57.745405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:57.786403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 815/1645] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:57.792802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:57.793587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:57.794061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:57.827727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d6a1-12ab-46b9-aa69-9d9cc767cb4c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:57.838696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:57.839395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:57.839671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:57.839945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] PATH_INFO: `/v3/projects/0f42e5cd81d449efba58439d05cc0e59` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:57.841851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f42e5cd81d449efba58439d05cc0e59)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:57.844195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:57.854485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:57.855787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:57.883189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 816/1646] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:57.887146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:57.909820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d298fa8-6538-4af8-bfcd-a0ab5a3afa68 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:57.925211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:57.925922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:57.927055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:57.927345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:57.928287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:57.928567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:57.930497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:57.987093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 817/1647] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:57.988226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f42e5cd81d449efba58439d05cc0e59', 'request_id': 'req-9c72946e-ca78-43d5-ae20-1dab68ac32d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:57.989939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.004412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f42e5cd81d449efba58439d05cc0e59', 'request_id': 'req-9c72946e-ca78-43d5-ae20-1dab68ac32d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:58.016403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a314dc-e1d8-43af-b64a-3fa9ab1a903d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.020596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f42e5cd81d449efba58439d05cc0e59', 'request_id': 'req-9c72946e-ca78-43d5-ae20-1dab68ac32d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:58.049239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] The token cache is being invalidate because project 0f42e5cd81d449efba58439d05cc0e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:43:58.050531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:58.051955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9c72946e-ca78-43d5-ae20-1dab68ac32d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:43:58.053677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 831/1648] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:43:57 2022] DELETE /identity/v3/projects/0f42e5cd81d449efba58439d05cc0e59 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:58.060157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ab4a-4284-4f19-9ad2-ecd8020d7e73 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.060460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ab4a-4284-4f19-9ad2-ecd8020d7e73 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.060718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ab4a-4284-4f19-9ad2-ecd8020d7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.112506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c365ab4a-4284-4f19-9ad2-ecd8020d7e73 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:58.114642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c365ab4a-4284-4f19-9ad2-ecd8020d7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:58.175647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.175647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.175647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.175647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.176386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.177405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.242785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 832/1649] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:43:58.250556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.251012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.251485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.259035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 818/1650] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:57 2022] POST /identity/v3/projects => generated 372 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:58.260068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.267017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:58.303981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:58.309621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:58.329515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:58.434192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced56a2-e38d-496e-99ca-7a6c1fdc4fe1 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.449273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.450032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.450459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.450596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.451322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.455014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.470135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 833/1651] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:58.474636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.508149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 819/1652] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:58 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:58.513974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.514456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46671bc9-b407-4393-8531-c0ea334137e3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.533998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.534863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.535105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.535682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.536116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:43:58.536470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.539946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36d01-d8f1-4daf-bc1f-a19158b9fe21 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.544005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.558392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.559132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.559471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.559895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.560632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.588179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.614703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 820/1653] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:58 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:43:58.619441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.627890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 834/1654] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:43:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:43:58.628963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.672711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06cbd-3f21-49f6-b91f-b166b72c87bd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.676364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1cd3d-7ea4-4ba2-83a1-78b9857e3dff admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:58.683883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.693518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.699411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:58.699708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.699789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:58.699789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:58.699789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.699789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.702139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:58.703090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:58.705386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.707086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:58.711576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:58.751893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 821/1655] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:58 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:58.752802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.779633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 835/1656] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:58 2022] POST /identity/v3/projects => generated 406 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:58.786206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:58.797131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b31bf-b625-4cca-9cc1-304e3fe9fe41 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.028992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb31a4-56ce-4cb3-887d-f1d2af2cef89 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.034859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.035654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.035944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.036226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] PATH_INFO: `/v3/projects/26b6e50ce5314ed58c0960d0df5e7896/users/8e1d00d8b46649bf941b75a6bd6c40dc/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.044890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.045480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.045764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.046038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.046730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.064337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.099882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b6e50ce5314ed58c0960d0df5e7896, user_id=8e1d00d8b46649bf941b75a6bd6c40dc, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.102764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a76469-f702-4d8b-94c3-b46e0fa23a5a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.167515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 836/1657] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:58 2022] POST /identity/v3/users => generated 304 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:59.168607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:59.189896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 822/1658] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:58 2022] PUT /identity/v3/projects/26b6e50ce5314ed58c0960d0df5e7896/users/8e1d00d8b46649bf941b75a6bd6c40dc/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:59.202275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.202582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.202873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.211678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863797-10ec-4f31-ba13-02e9c6741d77 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.306032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] MFA Rules not processed for user `8e1d00d8b46649bf941b75a6bd6c40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:59.307308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:59.437529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.438201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.438559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.438839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.439610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.449208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.479117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 837/1659] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:59.494365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:59.526863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e825-4ef6-4487-a7e3-3afe37c38da1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.538468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.543336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.543336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.543336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.543336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.544209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 823/1660] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:43:59.544856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:59.546049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.554338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:59.571516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564796a-ec37-45cc-bc81-9897d9296df0 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.581510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 838/1661] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:43:59.583607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:59.597909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.599134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.599134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.599134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.611230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.617278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.625326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30d3e-9701-4410-b7a8-7c59fab0a183 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:43:59.638538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:43:59.640014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.640303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.640623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] PATH_INFO: `/v3/projects/dc74d19716584ba094a824618043cc05/users/5a31db1102dc4182b6f9a3d5dfdb5fa6/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.698896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 824/1662] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:43:59 2022] POST /identity/v3/projects => generated 374 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:43:59.699995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:43:59.701724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc74d19716584ba094a824618043cc05, user_id=5a31db1102dc4182b6f9a3d5dfdb5fa6, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:43:59.704576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb164-9752-4aa0-ab81-28969f4ef33c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:43:59.760376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 839/1663] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:43:59 2022] PUT /identity/v3/projects/dc74d19716584ba094a824618043cc05/users/5a31db1102dc4182b6f9a3d5dfdb5fa6/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:43:59.765510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:43:59.765805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:43:59.766088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:43:59.859125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:43:59.860710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:43:59.923684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:59.991613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e251855-86be-4759-87d2-f1c37cc9f66d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:00.112279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 840/1664] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:43:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:00.191305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:00.192386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:00.192900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:00.193435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:00.194226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:00.202325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:00.245531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 825/1665] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:43:59 2022] POST /identity/v3/users => generated 294 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:00.251113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:00.266008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f707-e3c5-4e66-abae-c907a9a1107d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:00.285832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:00.286690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:00.287136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:00.287523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:00.288856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:00.290845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:00.314867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 841/1666] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:00.321658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:00.346084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953258b-13b7-48d0-be63-1c593538fc57 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:00.370866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:00.372279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:00.380739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:00.381064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] PATH_INFO: `/v3/projects/8e162037a3d54c569cf7b62bd41b6c37/users/9344e2d69ca04f1ba5ebd57eb4802f11/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:00.483884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e162037a3d54c569cf7b62bd41b6c37, user_id=9344e2d69ca04f1ba5ebd57eb4802f11, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:00.491648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:00.534879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:00.537155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:00.551387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 826/1667] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:00 2022] PUT /identity/v3/projects/8e162037a3d54c569cf7b62bd41b6c37/users/9344e2d69ca04f1ba5ebd57eb4802f11/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:00.553795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:00.775616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99242-81f7-4932-b428-fee153759cf3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:00.836677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e75b-64eb-45c1-a052-d6b255e2351b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:00.861887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:00.862681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:00.863036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:00.864777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:00.867633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:00.869393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:00.938202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 827/1668] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:00.939253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:01.001593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb0c6-9728-4198-b3d2-91757770b0b6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:01.029771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:01.030401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:01.030831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:01.031269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:01.038668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:01.039803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:01.041335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:01.042466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] PATH_INFO: `/v3/projects/8e162037a3d54c569cf7b62bd41b6c37/users/9344e2d69ca04f1ba5ebd57eb4802f11/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:01.048639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e162037a3d54c569cf7b62bd41b6c37, user_id=9344e2d69ca04f1ba5ebd57eb4802f11, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:01.053940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:01.057049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f7c13-eafc-4e6a-89d9-ded0674ee5f0 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:01.069420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:01.082242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 842/1669] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:00 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:01.109738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 828/1670] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:00 2022] PUT /identity/v3/projects/8e162037a3d54c569cf7b62bd41b6c37/users/9344e2d69ca04f1ba5ebd57eb4802f11/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:01.125604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:01.126067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:01.127018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:01.203014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] MFA Rules not processed for user `9344e2d69ca04f1ba5ebd57eb4802f11`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:01.204787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:01.237008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:01.477629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 843/1671] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:01.495965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:01.497835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:01.644265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:01.687048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6a18-9c4c-449a-9e4b-984de82bd9e9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:01.706481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:01.711178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:01.711814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:01.712239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:01.741462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:01.749230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:01.780201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 829/1672] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:02.036393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:02.048243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615dffb-39cb-4514-b537-50d2fa4358e9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:02.059111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:02.060041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:02.060475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:02.060887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:02.211220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:02.212780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dc1af-1016-4397-a2a7-601ac77de81e service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:02.229376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 844/1673] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:04.548131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:04.549645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:04.686315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f43af-1c0c-456f-a4f2-eb22bffdee5e service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:04.729978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:04.732016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:04.732627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:04.733373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] PATH_INFO: `/v3/users/cfbf451f436b4956ae724ed1f3735cec` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:04.738124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbf451f436b4956ae724ed1f3735cec)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:04.742513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:04.747086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d97c4-c450-4c5c-adef-e88a20ad98af None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:04.748897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d97c4-c450-4c5c-adef-e88a20ad98af None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:04.749532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d97c4-c450-4c5c-adef-e88a20ad98af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:04.858338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-df5d97c4-c450-4c5c-adef-e88a20ad98af None None] MFA Rules not processed for user `5a31db1102dc4182b6f9a3d5dfdb5fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:04.871940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-df5d97c4-c450-4c5c-adef-e88a20ad98af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:04.966846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbf451f436b4956ae724ed1f3735cec'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.015323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbf451f436b4956ae724ed1f3735cec'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.019418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbf451f436b4956ae724ed1f3735cec'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.049131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbf451f436b4956ae724ed1f3735cec'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.111030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-de4e74b2-a553-4384-ab2d-c0fb317cccb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbf451f436b4956ae724ed1f3735cec'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.137154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 830/1674] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:04 2022] DELETE /identity/v3/users/cfbf451f436b4956ae724ed1f3735cec => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:05.150846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:05.151315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:05.164920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:05.171236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 845/1675] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:04 2022] POST /identity/v3/auth/tokens => generated 3292 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:05.173754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:05.174470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:05.177002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:05.228562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:05.232986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.262564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] MFA Rules not processed for user `8e1baad75342476aa0c64bda0414e334`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:05.264544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.322582 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:05.423654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 846/1676] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:05.423654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:05.424126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.456525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b7be-434b-4892-a215-f8bcce738ed0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:05.470516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:05.471170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:05.471474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:05.471750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:05.476586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:05.481562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:05.481711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:05.513336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 831/1677] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:05.513336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:05.514446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.543409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0e08-5ccd-4a73-b9cd-8a22d89169b9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:05.555785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:05.557438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:05.557722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:05.559409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] PATH_INFO: `/v3/users/c54a4bb45ba247c9ae4650c0c520f803` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:05.559573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 847/1678] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:05 2022] POST /identity/v3/projects => generated 406 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:05.560715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:05.561824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54a4bb45ba247c9ae4650c0c520f803)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:05.563508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.565820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:05.694903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54a4bb45ba247c9ae4650c0c520f803'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.711099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54a4bb45ba247c9ae4650c0c520f803'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.715212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54a4bb45ba247c9ae4650c0c520f803'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.735256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54a4bb45ba247c9ae4650c0c520f803'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.753485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54a4bb45ba247c9ae4650c0c520f803'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:05.783350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 832/1679] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:05 2022] DELETE /identity/v3/users/c54a4bb45ba247c9ae4650c0c520f803 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:05.784757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa019b85-d9e0-4368-b876-3dc4b4e3214f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:05.793253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:05.798078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:05.898744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:05.900164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:05.900844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:05.901646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:05.915540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:06.044794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.046387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.061961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 848/1680] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:06.062901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.064456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:06.088022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d743d4b-df7b-407e-b995-50ddf918a5c7 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.097704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98935221-0892-4607-86fc-b0632b56a1f4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.101235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.101496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.101780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.102060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.102742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.108730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa863-ce54-425b-82fc-1783a74c8cf6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.116386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.120605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.120894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.121614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.123688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:06.181097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 849/1681] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:06 2022] POST /identity/v3/users => generated 310 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:06.183884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.184421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.184838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.202561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:06.236598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:06.237768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:06.253008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 850/1682] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:06.253967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.269275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b92ca-d15e-4953-bd7c-4974b69f1a24 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.269545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.274942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.284644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.285631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.285958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.286244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.287972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.289228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.300366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 833/1683] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:06.312902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.317545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 851/1684] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:06 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:06.318593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:06.320484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.341790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:06.343743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171438-c50d-4843-89ae-fc1def7e8559 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.366231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.366894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.367183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.368551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] PATH_INFO: `/v3/projects/90ae985a6ade49c68733100657de5a70/users/5d737d91b6e94a1bbd6a1216f35e9b59/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.368701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a556-76ee-4889-b32a-7b7bb6c9d013 service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.388698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.391097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.393041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.393282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.429311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae985a6ade49c68733100657de5a70, user_id=5d737d91b6e94a1bbd6a1216f35e9b59, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.444575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.447572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.449093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.486371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 834/1685] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:06 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:06.495015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 852/1686] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:06 2022] PUT /identity/v3/projects/90ae985a6ade49c68733100657de5a70/users/5d737d91b6e94a1bbd6a1216f35e9b59/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:06.496421 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.524238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0de5-3a81-4ed9-8076-6f525a0e05fa service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.680774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.681490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.681705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.681980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.684116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.687631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.718306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 835/1687] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:06 2022] GET /identity/v3/roles => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:06.722221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:06.738419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38ac44-da3b-494b-bfbe-30e09d845a33 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:06.754693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:06.755862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:06.756275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:06.757062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] PATH_INFO: `/v3/projects/90ae985a6ade49c68733100657de5a70/users/5d737d91b6e94a1bbd6a1216f35e9b59/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:06.763150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae985a6ade49c68733100657de5a70, user_id=5d737d91b6e94a1bbd6a1216f35e9b59, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:06.766861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe33106-6bc6-4e80-89d7-b194ceb43137 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:06.802297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 853/1688] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:06 2022] PUT /identity/v3/projects/90ae985a6ade49c68733100657de5a70/users/5d737d91b6e94a1bbd6a1216f35e9b59/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:07.345211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:07.348297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:07.379945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6d394-59b3-43e7-9452-fc4874ca3c57 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:07.542527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:07.542820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:07.543098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:07.585804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] MFA Rules not processed for user `396a79cbb4e9494791422713c596bc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:07.589020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:07.684994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:07.685780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:07.686070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:07.686356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] PATH_INFO: `/v3/projects/1ca919e1b2804871bdfab9882085f05f` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:07.688272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca919e1b2804871bdfab9882085f05f)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:07.689573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: WARNING py.warnings [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:44:07.689573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: warnings.warn(msg) Aug 05 20:44:07.689573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: Aug 05 20:44:07.690814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:07.760795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 854/1689] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:07.776536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:07.778289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:07.865600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e4ba2-06a5-4eaa-87c2-3d64353cdfb2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:07.891119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca919e1b2804871bdfab9882085f05f', 'request_id': 'req-e26b5fdf-b752-4224-9921-f7a4c97d074e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:07.924715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:07.948884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca919e1b2804871bdfab9882085f05f', 'request_id': 'req-e26b5fdf-b752-4224-9921-f7a4c97d074e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:07.987718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca919e1b2804871bdfab9882085f05f', 'request_id': 'req-e26b5fdf-b752-4224-9921-f7a4c97d074e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.019787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:08.022951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:08.023521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:08.025267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:08.029495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] The token cache is being invalidate because project 1ca919e1b2804871bdfab9882085f05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:08.031308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.033292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.038772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 836/1690] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:07 2022] DELETE /identity/v3/projects/1ca919e1b2804871bdfab9882085f05f => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:08.042650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:08.045411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:08.117759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:08.213164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5fdf-b752-4224-9921-f7a4c97d074e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:08.223306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:08.224351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:08.224774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:08.225584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] PATH_INFO: `/v3/users/d77535dcc43540cc9d1ad38459fd593b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:08.228674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77535dcc43540cc9d1ad38459fd593b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:08.232478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:08.271265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:08.303202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:08.350201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 855/1691] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:08.398487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77535dcc43540cc9d1ad38459fd593b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.436183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77535dcc43540cc9d1ad38459fd593b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.436965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77535dcc43540cc9d1ad38459fd593b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.453445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77535dcc43540cc9d1ad38459fd593b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.494961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1374a804-3a87-4792-99b4-7195d0db01ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77535dcc43540cc9d1ad38459fd593b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:08.513734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 837/1692] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:08 2022] DELETE /identity/v3/users/d77535dcc43540cc9d1ad38459fd593b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:09.476572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:09.478072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:09.516922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae56a7-5f1a-4230-9b2b-dba1fdb2dd94 service nova] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:09.638578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:09.639505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:09.639778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:09.640209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] PATH_INFO: `/v3/projects/d8f52d460eea4e87be00d2f9712f0867` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:09.641662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f52d460eea4e87be00d2f9712f0867)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:09.643640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:09.741568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f52d460eea4e87be00d2f9712f0867', 'request_id': 'req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:09.755233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f52d460eea4e87be00d2f9712f0867', 'request_id': 'req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:09.770391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f52d460eea4e87be00d2f9712f0867', 'request_id': 'req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:09.809669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] The token cache is being invalidate because project d8f52d460eea4e87be00d2f9712f0867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:09.810094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:09.811226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-17789ae7-5672-4ffb-85b7-7dc6d1cea74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:09.813667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 856/1693] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:09 2022] DELETE /identity/v3/projects/d8f52d460eea4e87be00d2f9712f0867 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:09.818990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:09.819805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:09.820748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:09.864894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:09.868441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:10.016478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 838/1694] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:10.024202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.024622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.024962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.040417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:10.093290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:10.101380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:10.115988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 857/1695] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:10.119652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.131147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264d9c9-9d96-435a-a9cc-7d2bce9867bc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.138827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.139846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.140726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.141109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.142046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:10.142493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.145366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.207170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 839/1696] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:10.211409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.233327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e1af3-7f85-4464-be3a-f30a70efd8d6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.254549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.255639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.258591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.259576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.261758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.269130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.354904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 858/1697] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:10 2022] POST /identity/v3/projects => generated 366 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:10.358958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.372214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dbf9c-b20c-4646-b560-8a8346f6116f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.433171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:10.535084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.536393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.536795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.538190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.539344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.542226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.578379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 840/1698] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:10 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:10.582094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.599325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40503-059b-43f6-a9e6-6a46343489f0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.613358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.614480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.616320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.616849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.618498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.620607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.636419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 859/1699] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:10 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:10.640113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.659174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf7f6-d89a-4c8c-94e8-860c361c829d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.665986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.666758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.667110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.667504 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.669258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.670965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccac0d-40fc-45bd-beed-bb31643369b0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.688706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 841/1700] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:10 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:10.693487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:10.720349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa8e70-4be3-430b-b655-ecf3fa7f2b1b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:10.733317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:10.736717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.736913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.737198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] PATH_INFO: `/v3/projects/02dde36650b7418bbaf56b4e7038277f/users/00f1c77498b24a84982d5e5bb93c4a5e/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.769530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dde36650b7418bbaf56b4e7038277f, user_id=00f1c77498b24a84982d5e5bb93c4a5e, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:10.779075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:10.804914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 860/1701] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:10 2022] PUT /identity/v3/projects/02dde36650b7418bbaf56b4e7038277f/users/00f1c77498b24a84982d5e5bb93c4a5e/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:10.816198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:10.816796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:10.817100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:10.900351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] MFA Rules not processed for user `00f1c77498b24a84982d5e5bb93c4a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:10.901635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.079004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 842/1702] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:11.085083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:11.261936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a16d8-16b5-4576-88e9-5de29114fd3e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:11.267183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:11.270673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:11.271323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.271862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.273752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.274225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.275029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:11.280301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:11.291712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03116c-19d0-4c05-ba04-40bac8d0399f None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:11.303010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:11.304661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.305538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.306160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] PATH_INFO: `/v3/projects/8db087b9ccc344e089a66aea885a6058` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.309621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db087b9ccc344e089a66aea885a6058)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:11.313298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:11.364003 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 861/1703] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:11 2022] POST /identity/v3/projects => generated 364 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:11.365426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:11.448292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db087b9ccc344e089a66aea885a6058', 'request_id': 'req-409e3b6b-9921-4afe-8570-8b51ee9b765b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:11.458230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db087b9ccc344e089a66aea885a6058', 'request_id': 'req-409e3b6b-9921-4afe-8570-8b51ee9b765b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:11.478648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db087b9ccc344e089a66aea885a6058', 'request_id': 'req-409e3b6b-9921-4afe-8570-8b51ee9b765b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:11.518133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] The token cache is being invalidate because project 8db087b9ccc344e089a66aea885a6058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:11.518808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:11.521807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-409e3b6b-9921-4afe-8570-8b51ee9b765b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:11.526439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 843/1704] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:11 2022] DELETE /identity/v3/projects/8db087b9ccc344e089a66aea885a6058 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:11.532176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073e22-7a28-4003-89d3-f56d9ce08407 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.532931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073e22-7a28-4003-89d3-f56d9ce08407 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.538316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073e22-7a28-4003-89d3-f56d9ce08407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.597284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ba7fd-effe-4660-ab1d-c17601a6636c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:11.645020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:11.651278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e8073e22-7a28-4003-89d3-f56d9ce08407 None None] MFA Rules not processed for user `44ac4775be0244df8fa0ee51a765c03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:11.654167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e8073e22-7a28-4003-89d3-f56d9ce08407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.692558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:11.773114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:11.773845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.774128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.774411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.775110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:11.785242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:11.811772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 844/1705] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:11.813714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.813714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.813714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.853075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 862/1706] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:11 2022] POST /identity/v3/users => generated 289 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:11.855101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:11.857381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.864696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:11.866373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.900141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 845/1707] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:11.900141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:11.901472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:11.922391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34dcc-a9c4-4350-9898-34704c0d9cbd None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:11.937978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:11.938654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.938941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.939225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:11.939986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:11.941660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea7b31-c71f-4793-87a2-16cdd89260a6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:11.964292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 846/1708] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:11.965567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c23c7-ba68-4638-a6da-940f91b56cb5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:11.965868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c23c7-ba68-4638-a6da-940f91b56cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:11.966149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c23c7-ba68-4638-a6da-940f91b56cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.030723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeafb7-465c-443f-9bed-bf889aca612a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:12.033574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f18c23c7-ba68-4638-a6da-940f91b56cb5 None None] MFA Rules not processed for user `5d737d91b6e94a1bbd6a1216f35e9b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:12.034929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f18c23c7-ba68-4638-a6da-940f91b56cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:12.044401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:12.045071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.045410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.046152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.095101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:12.097855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90719d-bd8a-4801-b537-110a36dbeae1 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:12.116427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 863/1709] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:12.120414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.123940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.125084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.200409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:12.203420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:12.236368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 864/1710] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:12.236368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.252276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 847/1711] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:12.256631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01316898-a04b-4d83-884c-acde8688f585 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.256631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01316898-a04b-4d83-884c-acde8688f585 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.256631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01316898-a04b-4d83-884c-acde8688f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.274428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75206-96bd-408d-a8a2-4b74832848b1 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:12.297614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:12.298397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.298677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.298950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] PATH_INFO: `/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976/users/bf07b7b1722845158c26cd991ab1ffc1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.324754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-01316898-a04b-4d83-884c-acde8688f585 None None] MFA Rules not processed for user `8e1baad75342476aa0c64bda0414e334`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:12.350038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-01316898-a04b-4d83-884c-acde8688f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:12.373767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cac9ea7854b41b38da6dd6fcb76c976, user_id=bf07b7b1722845158c26cd991ab1ffc1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:12.384843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:12.426991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 865/1712] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:12 2022] PUT /identity/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976/users/bf07b7b1722845158c26cd991ab1ffc1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:12.428289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.571054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 848/1713] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:12.580649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.581265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.581845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.647577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181435a-33b7-4b04-8c26-bda6a6a0f7b5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:12.659272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] MFA Rules not processed for user `4dc2f277a1d04094a77c6a0c90420f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:12.661223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:12.663308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:12.664007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.664399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.665439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.665704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:12.666317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:12.668593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:12.676782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:12.704316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 866/1714] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:12.704316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.716216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081876-6fa6-4c86-9f94-e107f3133198 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:12.737857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:12.738887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.739159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.739528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.740278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:12.742152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:12.752460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:12.786004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 867/1715] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:12 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:12.788253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.816398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a4dd-a2d8-4eac-92f5-c1f33e1a99e2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:12.829443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:12.830986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:12.830986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:12.830986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:12.831459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:12.833547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:12.892764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 868/1716] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:12 2022] POST /identity/v3/projects => generated 376 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:12.896739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.902128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 849/1717] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:12.903063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:12.969235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f090bd7-8882-4b13-9e11-e0ffffc8859c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.075588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86759d-c927-448c-9d38-375383acb6ec admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.092718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.092930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.093214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.093573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] PATH_INFO: `/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976/users/bf07b7b1722845158c26cd991ab1ffc1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.100652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cac9ea7854b41b38da6dd6fcb76c976, user_id=bf07b7b1722845158c26cd991ab1ffc1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.104235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c448368-2900-409f-b994-a1e79702175a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.120753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 869/1718] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:12 2022] PUT /identity/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976/users/bf07b7b1722845158c26cd991ab1ffc1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:13.122281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.122591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.122944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.142676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.145196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.145593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.146644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.148975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.154379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028697a-4a0f-4d1c-a922-4d7709c0b58a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.161966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] MFA Rules not processed for user `4dc2f277a1d04094a77c6a0c90420f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:13.168635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:13.207893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 850/1719] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:12 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:13.215954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.220398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.220933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.290421 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] MFA Rules not processed for user `bf07b7b1722845158c26cd991ab1ffc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:13.292629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:13.295221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 870/1720] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:13.299242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.505066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 851/1721] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:13.511725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.536505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a738c-c738-4f26-bd44-7dda2aa277a4 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.551146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.551930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.552243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.552586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.553407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.555304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.563069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:13.584784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 871/1722] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:13 2022] GET /identity/v3/roles => generated 1427 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:13.586094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.595058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:13.628349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:13.709932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5e6d3-f593-477c-a608-c5a201edbe1c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.735971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c272-2fa8-4c77-8d10-33bf1e8b59ba admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.741553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.742502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.745975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.746276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.753188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.753866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.754174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.754451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.771091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.772826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.777997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.779572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.796230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 852/1723] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:13.797074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.798322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 872/1724] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:13.854672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced380de-378d-4043-a681-12e00ce4ce2c service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.872928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c979-2285-454a-86d3-18041677324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.874885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c979-2285-454a-86d3-18041677324e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.875178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c979-2285-454a-86d3-18041677324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.879805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c979-2285-454a-86d3-18041677324e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:13.881949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c979-2285-454a-86d3-18041677324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:13.886979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c979-2285-454a-86d3-18041677324e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:13.925750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 853/1725] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:13 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:13.930843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.969563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8dc70-d205-4496-9425-b413ba8c4505 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:13.986594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c979-2285-454a-86d3-18041677324e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:13.988115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:13.988963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:13.989325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:13.989659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] PATH_INFO: `/v3/projects/ccd7ac06c27243dd92e2156e2715336e/users/13514475ac0c49818626bb43adfa8339/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.014265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c979-2285-454a-86d3-18041677324e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:14.034520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:14.035443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:14.036107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:14.036613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.039331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:14.049150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd7ac06c27243dd92e2156e2715336e, user_id=13514475ac0c49818626bb43adfa8339, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:14.052078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d30f1-e45c-44b2-8a92-b2543ed17d2b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:14.079428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 873/1726] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:13 2022] PUT /identity/v3/projects/ccd7ac06c27243dd92e2156e2715336e/users/13514475ac0c49818626bb43adfa8339/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:14.095515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ace9-dbc7-49e4-afab-b875a88c6bf1 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:14.095847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ace9-dbc7-49e4-afab-b875a88c6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:14.096182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ace9-dbc7-49e4-afab-b875a88c6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.166333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c8d3ace9-dbc7-49e4-afab-b875a88c6bf1 None None] MFA Rules not processed for user `13514475ac0c49818626bb43adfa8339`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:14.167741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c8d3ace9-dbc7-49e4-afab-b875a88c6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:14.221588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:14.224729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:14.250268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 854/1727] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:14.357700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 874/1728] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:14.460281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:14.463294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:14.548289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967847-f564-41d3-b484-b76d94ed3851 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:14.640065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf1b-e1f6-4ada-b0b4-4d2efaa53547 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:14.640563 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf1b-e1f6-4ada-b0b4-4d2efaa53547 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:14.641148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf1b-e1f6-4ada-b0b4-4d2efaa53547 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.642847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 875/1729] 10.222.0.100 () {54 vars in 917 bytes} [Fri Aug 5 20:44:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:44:14.655160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae57c-37b3-4489-b946-783dbf4221fe None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:14.655780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae57c-37b3-4489-b946-783dbf4221fe None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:14.656306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae57c-37b3-4489-b946-783dbf4221fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.705285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:14.706160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:14.706728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:14.706989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:14.734755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:14.736559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:14.792007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 855/1730] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:14.824579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-02eae57c-37b3-4489-b946-783dbf4221fe None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:14.826039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-02eae57c-37b3-4489-b946-783dbf4221fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:15.009358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 876/1731] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:15.525328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:15.527990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:15.593874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee65e4-17e7-4b0c-989c-62f10da36fbb service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:15.623665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:15.631984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:15.632608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:15.635767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:15.669310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:15.676956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0a2b3-22b9-4393-902a-771054e2bc61 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:15.714513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 856/1732] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:15 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:15.857479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558f5c8-11f3-4a26-b1e6-d53b8f37487b None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:15.858032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558f5c8-11f3-4a26-b1e6-d53b8f37487b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:15.858032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558f5c8-11f3-4a26-b1e6-d53b8f37487b None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:15.859873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 877/1733] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:44:15 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:44:15.918441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376494bb-636a-479f-9063-0df6c97658c4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:15.918833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376494bb-636a-479f-9063-0df6c97658c4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:15.919051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376494bb-636a-479f-9063-0df6c97658c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:15.973726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-376494bb-636a-479f-9063-0df6c97658c4 None None] MFA Rules not processed for user `44ac4775be0244df8fa0ee51a765c03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:15.974962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-376494bb-636a-479f-9063-0df6c97658c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:15.996051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:16.054152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5d82-b602-4860-b1a2-4cd8e3d3ffed None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.054438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5d82-b602-4860-b1a2-4cd8e3d3ffed None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.054875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5d82-b602-4860-b1a2-4cd8e3d3ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.066800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 857/1734] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:16.079811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c003-bf03-40a9-982d-bd7a4409a2ee None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.081055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c003-bf03-40a9-982d-bd7a4409a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.081055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c003-bf03-40a9-982d-bd7a4409a2ee None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.087349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 858/1735] 10.222.0.100 () {54 vars in 917 bytes} [Fri Aug 5 20:44:16 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:44:16.090121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.090748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.091025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.111718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a50e5d82-b602-4860-b1a2-4cd8e3d3ffed None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:16.118009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a50e5d82-b602-4860-b1a2-4cd8e3d3ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:16.125828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:16.128233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:16.147557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:16.150048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 859/1736] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:16.241700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:16.258094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3a0de-bf1d-4134-838b-9a8c7d8b3d73 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:16.275313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:16.278317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.278601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.278877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.295387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:16.295914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944fe89-e733-4e23-b136-c2071c226525 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:16.310638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 878/1737] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:16.315336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 860/1738] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:16.381796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632a4c-bd01-4d67-bc2b-440e7ca5309d None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.381796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632a4c-bd01-4d67-bc2b-440e7ca5309d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.381796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632a4c-bd01-4d67-bc2b-440e7ca5309d None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.384219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 879/1739] 10.222.0.100 () {54 vars in 966 bytes} [Fri Aug 5 20:44:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:44:16.390370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e633-1ac9-4a08-86bd-9ea2dd3e08f3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.391382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e633-1ac9-4a08-86bd-9ea2dd3e08f3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.391701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e633-1ac9-4a08-86bd-9ea2dd3e08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.492994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c316e633-1ac9-4a08-86bd-9ea2dd3e08f3 None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:16.504459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c316e633-1ac9-4a08-86bd-9ea2dd3e08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:16.541813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 861/1740] 10.222.0.100 () {58 vars in 1063 bytes} [Fri Aug 5 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:16.551981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49632a4c-bd01-4d67-bc2b-440e7ca5309d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:16.597859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49632a4c-bd01-4d67-bc2b-440e7ca5309d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:16.616885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:16.617559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:16.617807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:16.618076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:16.658226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:16.660131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72831-a648-45dc-a2e5-7e2d8f70ede1 service placement] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:16.697271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 880/1741] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:17.614323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:17.614741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:17.614896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:17.667205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] MFA Rules not processed for user `396a79cbb4e9494791422713c596bc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:17.672267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:17.816827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404e5c9-0827-4813-8c67-e760526eed19 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:17.817813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404e5c9-0827-4813-8c67-e760526eed19 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:17.818513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404e5c9-0827-4813-8c67-e760526eed19 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:17.821002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 881/1742] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:44:17 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:44:17.965217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 862/1743] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:18.101903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:18.102609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:18.103029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:18.168834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] MFA Rules not processed for user `93ed5ec5662f4ca383b4c2e1653d150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:18.174083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:18.206292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:18.211004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:18.240115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 882/1744] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:44:18 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:18.254358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:18.272732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f337-04d8-4fde-a289-908ff072de6c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:18.312838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:18.316141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:18.317149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:18.331617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:18.395752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:18.403886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2882ad-6628-4d7d-a566-516cd2198770 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:18.412345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:18.418838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:18.419558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:18.419847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:18.420126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] PATH_INFO: `/v3/users/5a31db1102dc4182b6f9a3d5dfdb5fa6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:18.421900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a31db1102dc4182b6f9a3d5dfdb5fa6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:18.423726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:18.483813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 883/1745] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:18 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:18.485240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:18.488291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:18.528983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b9cff-cbda-4a9f-9899-1acd175a07f6 service placement] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:18.535520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:18.536545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:18.536953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:18.537438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:18.541870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:18.545318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a31db1102dc4182b6f9a3d5dfdb5fa6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:18.546957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:18.560523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a31db1102dc4182b6f9a3d5dfdb5fa6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:18.561333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a31db1102dc4182b6f9a3d5dfdb5fa6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:18.574327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:18.577729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:18.582886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a31db1102dc4182b6f9a3d5dfdb5fa6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:18.594231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 884/1746] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:18 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:18.622275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a31db1102dc4182b6f9a3d5dfdb5fa6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:18.643311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 863/1747] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:18 2022] DELETE /identity/v3/users/5a31db1102dc4182b6f9a3d5dfdb5fa6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:19.970684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:19.985110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becd9f-6904-4493-b99b-5a76802b7968 service placement] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:20.089580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:20.090418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:20.090792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:20.091186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] PATH_INFO: `/v3/projects/dc74d19716584ba094a824618043cc05` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:20.095276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc74d19716584ba094a824618043cc05)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:20.098184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:20.284211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc74d19716584ba094a824618043cc05', 'request_id': 'req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.309971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc74d19716584ba094a824618043cc05', 'request_id': 'req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.338254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc74d19716584ba094a824618043cc05', 'request_id': 'req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.351060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:20.378494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] The token cache is being invalidate because project dc74d19716584ba094a824618043cc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:20.378794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.380433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.387588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 885/1748] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:19 2022] DELETE /identity/v3/projects/dc74d19716584ba094a824618043cc05 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:20.388574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:20.391730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:20.456947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8066-832b-41ad-ac3b-c489609584cf admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:20.566766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:20.567543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:20.567816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:20.568100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] PATH_INFO: `/v3/users/5d737d91b6e94a1bbd6a1216f35e9b59` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:20.569744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d737d91b6e94a1bbd6a1216f35e9b59)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:20.572643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:20.788030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d737d91b6e94a1bbd6a1216f35e9b59'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.847318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d737d91b6e94a1bbd6a1216f35e9b59'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.850655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d737d91b6e94a1bbd6a1216f35e9b59'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.888671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d737d91b6e94a1bbd6a1216f35e9b59'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.968220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-828be30e-f967-468e-9ed3-9cebcf0a0e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d737d91b6e94a1bbd6a1216f35e9b59'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:20.991406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 864/1749] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:20 2022] DELETE /identity/v3/users/5d737d91b6e94a1bbd6a1216f35e9b59 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:21.604021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:21.620740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:21.638256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6db7a2-97b3-483c-aafb-e1431a1ffdb1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:21.733140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:21.734650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:21.735196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:21.735881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] PATH_INFO: `/v3/projects/90ae985a6ade49c68733100657de5a70` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:21.738163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ae985a6ade49c68733100657de5a70)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:21.740917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:21.808489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ae985a6ade49c68733100657de5a70', 'request_id': 'req-1b85aaa6-ce13-49e9-b89c-f41613e108cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:21.819172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ae985a6ade49c68733100657de5a70', 'request_id': 'req-1b85aaa6-ce13-49e9-b89c-f41613e108cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:21.828418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ae985a6ade49c68733100657de5a70', 'request_id': 'req-1b85aaa6-ce13-49e9-b89c-f41613e108cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:21.845712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] The token cache is being invalidate because project 90ae985a6ade49c68733100657de5a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:21.846354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:21.847112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1b85aaa6-ce13-49e9-b89c-f41613e108cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:21.848687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 886/1750] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:21 2022] DELETE /identity/v3/projects/90ae985a6ade49c68733100657de5a70 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:21.853739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:21.854262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:21.854420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:21.876477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:21.877771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:21.925577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:21.952689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 865/1751] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:21.960782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:21.961114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:21.961403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:21.984715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:21.985982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:21.999665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 887/1752] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:22.005676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.017557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9c2d-085c-402b-af9c-0be27a825612 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.024493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.025363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.025736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.026288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.027266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:22.027741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.033996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.045253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 866/1753] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:22.050087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.059989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10cc8f-d2da-46fc-a15f-a1d4a55fc5b9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.064955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.065699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.065978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.066246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.066916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.068947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.101236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 888/1754] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:22 2022] POST /identity/v3/projects => generated 386 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:22.105700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.119217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51683384-f17a-4c72-8227-e3329c17403f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.195190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.195981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.196302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.196705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.197571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.199540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.226406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 867/1755] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:22 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:22.231564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.243729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4502d-3241-4703-ba91-30f0cb481270 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.249577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.250216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.250495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.250769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.251570 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.253350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.269134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 889/1756] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:22 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:22.273536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.284999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d5c1-5c27-413f-ade9-aa6a6806a0d0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.291315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.292012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.292296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.292565 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.293287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.296691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3ea7c-6b1e-41c1-a8a5-d7e35da74a03 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.309675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 868/1757] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:22 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:22.316460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.332853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9364437-fa82-4e9d-ab4e-b430772507cc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.341331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.342430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.342710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.342939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] PATH_INFO: `/v3/projects/904e648f17cd459282cdf2c6b730d072/users/0fa13fbf3a8f4fd0807d2700823fa099/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.364732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=904e648f17cd459282cdf2c6b730d072, user_id=0fa13fbf3a8f4fd0807d2700823fa099, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.370107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.387894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 890/1758] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:22 2022] PUT /identity/v3/projects/904e648f17cd459282cdf2c6b730d072/users/0fa13fbf3a8f4fd0807d2700823fa099/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:22.401823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.402129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.402409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.449537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] MFA Rules not processed for user `0fa13fbf3a8f4fd0807d2700823fa099`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:22.450765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:22.567029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 869/1759] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:22.572243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.610195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:22.682944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc8a6-d7a2-4fb2-95bd-58a303fdf21c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.698357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.699278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.699784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.700207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.701578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.704695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.764331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 891/1760] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:22 2022] POST /identity/v3/projects => generated 388 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:22.769655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.796991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c415-3f5a-4715-b40d-dbcf696b8b1c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.855970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:22.902590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.903246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.903679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.904126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.905010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.907320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:22.942815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 870/1761] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:22 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:22.948635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:22.963799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa270-9d20-4875-a359-95354f9ed10b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:22.980444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:22.984172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:22.984574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:22.984945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:22.985931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:22.990493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.024191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 892/1762] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:22 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:23.025836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.057017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82de69-02ee-42af-b1a9-d433b5079946 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.063236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.063938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.064268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.064513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.065394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.067233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759063-c13e-4db9-99fa-c99474499949 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.106681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 871/1763] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:23 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:23.113017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.135592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fce6b-ed19-4549-bc3d-915d3c02c776 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.153512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.154991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.155731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.156419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] PATH_INFO: `/v3/projects/6b1906b1ce0341279d5a20e86db6ba4d/users/0021b0485f6c4574a1f8e4a5ad91c4a5/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.238857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1906b1ce0341279d5a20e86db6ba4d, user_id=0021b0485f6c4574a1f8e4a5ad91c4a5, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.253763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.298983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 893/1764] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:23 2022] PUT /identity/v3/projects/6b1906b1ce0341279d5a20e86db6ba4d/users/0021b0485f6c4574a1f8e4a5ad91c4a5/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:23.320504 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.320927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.321385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.365358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] MFA Rules not processed for user `0021b0485f6c4574a1f8e4a5ad91c4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:23.367916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:23.466717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 872/1765] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:23.471478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.538652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f518c6-6435-4332-9b4f-76e087d54001 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.545048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.545694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.545974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.546247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.546979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.549184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.586933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 894/1766] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:23 2022] POST /identity/v3/projects => generated 386 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:23.598527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.611445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c04c-c1a0-44c7-b604-5fb7ad948b3d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.684448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.685101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.685384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.686524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.687274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.689414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.719241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 873/1767] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:23 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:23.723494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.742644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895eeb9-58dd-4aea-bd33-992a2fb9d6b2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.751919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.752618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.752910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.753284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.754076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.755950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.770948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 895/1768] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:23 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:23.776020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.788790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5792-0633-4723-b07f-d1c6ea3c23ac admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.794469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.795191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.795512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.795791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] PATH_INFO: `/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0/users/0ee18a2053a94c46b2f3e1b973504ca1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.816988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d27d58eb4c45c5b66c673cb46bb4e0, user_id=0ee18a2053a94c46b2f3e1b973504ca1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.820101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.839252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 874/1769] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:23 2022] PUT /identity/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0/users/0ee18a2053a94c46b2f3e1b973504ca1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:23.843985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.861452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b0ce0-7021-45ac-8ea2-b4016280fe04 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.928912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:23.954339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.955469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.956009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:23.956628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:23.961184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:23.961184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d0001-7cf6-48eb-8711-258b9189646c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:23.973498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 896/1770] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:23 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:23.980735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:23.992757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3fe72-9ae3-4978-95ac-32ff6d3e4a19 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:23.998751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:23.999546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:23.999836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:24.000109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] PATH_INFO: `/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0/users/0ee18a2053a94c46b2f3e1b973504ca1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:24.002281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d27d58eb4c45c5b66c673cb46bb4e0, user_id=0ee18a2053a94c46b2f3e1b973504ca1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:24.005037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:24.013016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:24.019248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 875/1771] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:23 2022] PUT /identity/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0/users/0ee18a2053a94c46b2f3e1b973504ca1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:24.029793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:24.030082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:24.030363 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:24.063603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] MFA Rules not processed for user `0ee18a2053a94c46b2f3e1b973504ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:24.065187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:24.170067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 897/1772] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:24.182718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:24.184709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:24.252642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844748-047a-41ac-95f6-0cf0dbffb2e9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:24.256752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:24.257380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:24.257665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:24.257940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:24.268178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:24.269814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fafc0f-bf31-40bd-9dc8-b04917208689 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:24.280784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 876/1773] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:24.917995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:24.930187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cefe5-4aff-491a-9c74-c3a6e694e1f9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:24.933864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:24.934499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:24.934775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:24.935044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:25.019901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:25.021344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:25.031394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 898/1774] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:27.477695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690df2-a7bc-42e4-b3ce-87a933fcba27 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:27.479342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690df2-a7bc-42e4-b3ce-87a933fcba27 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:27.479871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46690df2-a7bc-42e4-b3ce-87a933fcba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:27.648718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-46690df2-a7bc-42e4-b3ce-87a933fcba27 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:27.651447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-46690df2-a7bc-42e4-b3ce-87a933fcba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:27.911032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 877/1775] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:28.030682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:28.033050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:28.155533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:28.186312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8292a3-c042-4146-b0ad-83516adef393 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:28.193460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:28.194604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:28.195345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:28.195740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:28.207153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:28.211954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:28.222750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 899/1776] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:44:29.106464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1bf7-c108-44f4-bf2e-0b79a7eac9b4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:29.107770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1bf7-c108-44f4-bf2e-0b79a7eac9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:29.108192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d1bf7-c108-44f4-bf2e-0b79a7eac9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:29.224072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e70d1bf7-c108-44f4-bf2e-0b79a7eac9b4 None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:29.225118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e70d1bf7-c108-44f4-bf2e-0b79a7eac9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:29.511116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 878/1777] 10.222.0.121 () {58 vars in 1020 bytes} [Fri Aug 5 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:29.561815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:29.565594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:29.604202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610f50c-5155-4eab-9cf6-46992b13f83e service swift] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:29.618589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:29.620123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:29.620423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:29.620703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:29.648467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:29.651332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bdd2b-3233-4ffb-a5b4-1bb8017ea629 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:29.674257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 900/1778] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:31.318184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:31.319496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:31.319993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:31.321665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 879/1779] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:44:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:44:31.329454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:31.330587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:31.331058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:31.389666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:31.393321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:31.629269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:31.631168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 901/1780] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:31.631323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:31.666849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d10a-fc35-463a-80b1-9f48b4cb9a4d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:31.684584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:31.685227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:31.685514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:31.685955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:31.704993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:31.708535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:31.735377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 880/1781] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:31.794970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:31.797984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:31.806013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:31.836980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73603-e832-448a-b64f-18179da9e14a service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:31.851705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:31.853187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:31.854248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:31.854808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:31.868509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:31.970441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:31.977810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce345eb4-9906-4717-9d29-9332c2c47350 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:31.994056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5428f-4735-4952-b5e3-8d725f86a21d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:31.999773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:32.000467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:32.000752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:32.001029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] PATH_INFO: `/v3/users/00f1c77498b24a84982d5e5bb93c4a5e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:32.002041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 881/1782] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:32.002560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f1c77498b24a84982d5e5bb93c4a5e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:32.004946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:32.122695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f1c77498b24a84982d5e5bb93c4a5e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.124036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f1c77498b24a84982d5e5bb93c4a5e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.126166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f1c77498b24a84982d5e5bb93c4a5e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.141543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f1c77498b24a84982d5e5bb93c4a5e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.147903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:32.173420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f1c77498b24a84982d5e5bb93c4a5e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.209793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 902/1783] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:31 2022] DELETE /identity/v3/users/00f1c77498b24a84982d5e5bb93c4a5e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:32.215924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:32.216506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:32.216974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:32.244141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:32.246673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:32.330870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 882/1784] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:32.341316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:32.342941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:32.418060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb975c1-71df-492e-899c-378e363bc2ee admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:32.423609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:32.424764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:32.425247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:32.425782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:32.439558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:32.441818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:32.461197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 903/1785] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:32.818908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:32.820986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:32.847429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5875bd-2c23-4a9f-a623-f362f6cc0110 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:32.861019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:32.862143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:32.862774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:32.863086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] PATH_INFO: `/v3/projects/02dde36650b7418bbaf56b4e7038277f` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:32.864764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dde36650b7418bbaf56b4e7038277f)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:32.869094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:32.930275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dde36650b7418bbaf56b4e7038277f', 'request_id': 'req-50385a99-24ba-4d42-9a85-e7a516bdb25f'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.936761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dde36650b7418bbaf56b4e7038277f', 'request_id': 'req-50385a99-24ba-4d42-9a85-e7a516bdb25f'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.945408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dde36650b7418bbaf56b4e7038277f', 'request_id': 'req-50385a99-24ba-4d42-9a85-e7a516bdb25f'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.962597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] The token cache is being invalidate because project 02dde36650b7418bbaf56b4e7038277f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:32.963052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.963896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:32.967473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 883/1786] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:32 2022] DELETE /identity/v3/projects/02dde36650b7418bbaf56b4e7038277f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:32.970544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:32.982129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376110e-2fa5-4e5d-9268-aa366c913750 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:33.043242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:33.043978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.044259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.044535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] PATH_INFO: `/v3/users/bf07b7b1722845158c26cd991ab1ffc1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.045719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf07b7b1722845158c26cd991ab1ffc1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:33.047748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:33.095639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf07b7b1722845158c26cd991ab1ffc1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.096202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf07b7b1722845158c26cd991ab1ffc1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.096800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf07b7b1722845158c26cd991ab1ffc1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.105380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf07b7b1722845158c26cd991ab1ffc1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.113497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f95c03a1-bf90-4907-b98a-2cb6efc312a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf07b7b1722845158c26cd991ab1ffc1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.127968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:33.136588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 904/1787] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:32 2022] DELETE /identity/v3/users/bf07b7b1722845158c26cd991ab1ffc1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:33.547946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:33.549517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:33.564443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50385a99-24ba-4d42-9a85-e7a516bdb25f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:33.595371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:33.624931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:33.625633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.625919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.626245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] PATH_INFO: `/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.627519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cac9ea7854b41b38da6dd6fcb76c976)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:33.629523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:33.678783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cac9ea7854b41b38da6dd6fcb76c976', 'request_id': 'req-935346e4-2385-467c-981f-56208b0ba530'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.684782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cac9ea7854b41b38da6dd6fcb76c976', 'request_id': 'req-935346e4-2385-467c-981f-56208b0ba530'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.690800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cac9ea7854b41b38da6dd6fcb76c976', 'request_id': 'req-935346e4-2385-467c-981f-56208b0ba530'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.705782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] The token cache is being invalidate because project 4cac9ea7854b41b38da6dd6fcb76c976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:33.706160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.706855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-935346e4-2385-467c-981f-56208b0ba530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:33.708562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 884/1788] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:33 2022] DELETE /identity/v3/projects/4cac9ea7854b41b38da6dd6fcb76c976 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:33.714122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.714606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.714703 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.744368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:33.745595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:33.808676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 905/1789] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:33.816879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.817192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.817469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.838584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:33.839828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:33.848007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 885/1790] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:33.852474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:33.863031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b006ad9-1581-4b7a-8f93-b9a2824d10ed None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:33.868287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:33.868951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.869234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.869699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.870464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:33.870728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:33.873347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:33.890724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 906/1791] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:33.892235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:33.905079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed13b4b-6531-4ccc-ba12-e7d19d5edb4f None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:33.913073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:33.913727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:33.914013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:33.914319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:33.914973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:33.916984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:33.947779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 886/1792] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:33 2022] POST /identity/v3/projects => generated 392 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:33.952094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:33.968474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a167-3a79-47d8-9833-c00a6d2a4df1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.028600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.029339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.029686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.030022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.030755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.033362 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.056708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 907/1793] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:33 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:34.060952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.072388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975ec9-7f7f-4f8b-ad67-cd2b4ead0270 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.077989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.078610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.078891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.079186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.079915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.081726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.092677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 887/1794] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:34.096693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.106746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc573d8-a351-42ed-b720-27e1896b018a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.112295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.112914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.113196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.113468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.114170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.115902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6d69f-0cef-4161-b40d-5742426a3f74 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.134976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 908/1795] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:34.136031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.148061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197b02-82de-4e3b-bf8d-906fc4b4542b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.167382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.167382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.167382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.167382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] PATH_INFO: `/v3/projects/03d5c74a9f3d4b71a14b35728a3efbda/users/4c80070632114a2dbff21a7aa73517ae/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.184320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d5c74a9f3d4b71a14b35728a3efbda, user_id=4c80070632114a2dbff21a7aa73517ae, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.187485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.207426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 888/1796] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:34 2022] PUT /identity/v3/projects/03d5c74a9f3d4b71a14b35728a3efbda/users/4c80070632114a2dbff21a7aa73517ae/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:34.219990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.220365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.220716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.256734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] MFA Rules not processed for user `4c80070632114a2dbff21a7aa73517ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:34.258109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:34.319597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:34.363505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 909/1797] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:34.366096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.480051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97bb00-5980-4ede-b32d-e1b9ea6ac204 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.485594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.486382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.486804 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.487151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.488235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.491441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.513603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:34.600860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 889/1798] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:34 2022] POST /identity/v3/projects => generated 388 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:34.605215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.625675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c67921-fda2-47d3-9780-92dc94afc147 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.717244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.720686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.721164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.721681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.722738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.725310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.765572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 910/1799] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:34 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:34.770366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.786798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563009b-7db1-45e3-8ff7-4df4583449d5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.794951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.796643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.796939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.797436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.799044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.803679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.831969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 890/1800] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:34.832667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.849615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddefe9-be40-4267-a8af-91522244b240 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:34.869095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:34.869745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:34.870027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:34.870301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] PATH_INFO: `/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1/users/1e626bdeae22450aa88f7063b826d6d3/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:34.899686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5da29d40ff4bb6a32a4628cea329e1, user_id=1e626bdeae22450aa88f7063b826d6d3, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:34.902779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:34.940789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 911/1801] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:34 2022] PUT /identity/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1/users/1e626bdeae22450aa88f7063b826d6d3/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:34.942441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:34.963036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a09ce-30e6-4a91-8b07-4ec726736f52 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:35.076586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:35.077318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:35.077838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:35.078207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:35.078980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:35.080713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f006ae-3077-4d78-92ce-d7969bc97e1d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:35.108207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 891/1802] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:35.110898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:35.127004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208bd2-2830-4d2c-8344-b48651287e24 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:35.134975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:35.138326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:35.138946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:35.139710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] PATH_INFO: `/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1/users/1e626bdeae22450aa88f7063b826d6d3/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:35.143104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5da29d40ff4bb6a32a4628cea329e1, user_id=1e626bdeae22450aa88f7063b826d6d3, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:35.147097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:35.205092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 912/1803] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:35 2022] PUT /identity/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1/users/1e626bdeae22450aa88f7063b826d6d3/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:35.207937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cd77-777e-4c63-8466-086637a4334a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:35.208220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cd77-777e-4c63-8466-086637a4334a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:35.208619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578cd77-777e-4c63-8466-086637a4334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:35.247916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d578cd77-777e-4c63-8466-086637a4334a None None] MFA Rules not processed for user `1e626bdeae22450aa88f7063b826d6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:35.249838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d578cd77-777e-4c63-8466-086637a4334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:35.351414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 892/1804] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:35 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:35.361229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:35.362932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:35.428905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42699-5b9a-4864-af11-e290e06e96e0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:35.432617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:35.433354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:35.433716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:35.434055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:35.445444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:35.446307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:35.456634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 913/1805] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:35 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:35.506998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578cd77-777e-4c63-8466-086637a4334a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:35.508574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d578cd77-777e-4c63-8466-086637a4334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:35.521177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578cd77-777e-4c63-8466-086637a4334a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:35.526270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:35.527007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:35.527818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:35.527818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:35.590952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:35.594980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:35.596643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d37b-b8da-4d5e-9d58-798eb3132ded service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:35.607105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 893/1806] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:38.760807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:38.762381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:38.816754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:38.838098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4b61-baef-4451-a0cd-d80a9a4fac8b service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:38.843503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:38.844421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:38.844853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:38.845307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] PATH_INFO: `/v3/users/0fa13fbf3a8f4fd0807d2700823fa099` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:38.846898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa13fbf3a8f4fd0807d2700823fa099)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:38.849402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:38.972984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa13fbf3a8f4fd0807d2700823fa099'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:38.975867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa13fbf3a8f4fd0807d2700823fa099'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:38.977407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa13fbf3a8f4fd0807d2700823fa099'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:38.991259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa13fbf3a8f4fd0807d2700823fa099'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.014953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa13fbf3a8f4fd0807d2700823fa099'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.064830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 914/1807] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:38 2022] DELETE /identity/v3/users/0fa13fbf3a8f4fd0807d2700823fa099 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:39.069206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:39.070075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:39.070353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:39.098041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:39.099570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:39.201671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 894/1808] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:39 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:39.216725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:39.218690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:39.315829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f41a-1722-485b-9f10-46f1711e0899 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:39.323651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:39.324457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:39.324742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:39.325019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:39.343698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:39.345894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:39.358041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 915/1809] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:39 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:39.833273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:39.834886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:39.849133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47336-6e62-4de0-9474-db025d7c9184 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:39.855559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:39.856253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:39.856599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:39.856869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] PATH_INFO: `/v3/projects/904e648f17cd459282cdf2c6b730d072` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:39.858093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904e648f17cd459282cdf2c6b730d072)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:39.860070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:39.920286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904e648f17cd459282cdf2c6b730d072', 'request_id': 'req-db05ceb4-abda-4e98-929d-933a0c900b30'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.929269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904e648f17cd459282cdf2c6b730d072', 'request_id': 'req-db05ceb4-abda-4e98-929d-933a0c900b30'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.935816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904e648f17cd459282cdf2c6b730d072', 'request_id': 'req-db05ceb4-abda-4e98-929d-933a0c900b30'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.951699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] The token cache is being invalidate because project 904e648f17cd459282cdf2c6b730d072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:39.952139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.952854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:39.954700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 895/1810] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:39 2022] DELETE /identity/v3/projects/904e648f17cd459282cdf2c6b730d072 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:39.958527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:39.971393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195f1ac-40e8-41c5-be4c-8b615efc125a service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:40.036890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:40.037587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:40.037869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:40.038150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] PATH_INFO: `/v3/users/0021b0485f6c4574a1f8e4a5ad91c4a5` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:40.039445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0021b0485f6c4574a1f8e4a5ad91c4a5)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:40.041887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:40.054061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:40.102614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0021b0485f6c4574a1f8e4a5ad91c4a5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.103512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0021b0485f6c4574a1f8e4a5ad91c4a5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.104158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0021b0485f6c4574a1f8e4a5ad91c4a5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.116532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0021b0485f6c4574a1f8e4a5ad91c4a5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.124714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0021b0485f6c4574a1f8e4a5ad91c4a5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.143345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 916/1811] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:39 2022] DELETE /identity/v3/users/0021b0485f6c4574a1f8e4a5ad91c4a5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:40.675693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:40.677155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:40.708617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ceb4-abda-4e98-929d-933a0c900b30 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:40.803571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:40.803571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:40.803571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:40.803949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] PATH_INFO: `/v3/projects/6b1906b1ce0341279d5a20e86db6ba4d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:40.805207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1906b1ce0341279d5a20e86db6ba4d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:40.808163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:40.833517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:40.864166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1906b1ce0341279d5a20e86db6ba4d', 'request_id': 'req-8188e9dd-0bda-41a1-867f-5680bcc0fd85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.871269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1906b1ce0341279d5a20e86db6ba4d', 'request_id': 'req-8188e9dd-0bda-41a1-867f-5680bcc0fd85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.877124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1906b1ce0341279d5a20e86db6ba4d', 'request_id': 'req-8188e9dd-0bda-41a1-867f-5680bcc0fd85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.890358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] The token cache is being invalidate because project 6b1906b1ce0341279d5a20e86db6ba4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:40.890735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.891558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:40.893281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 896/1812] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:40 2022] DELETE /identity/v3/projects/6b1906b1ce0341279d5a20e86db6ba4d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:40.897529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:40.899092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:40.913167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84808b-5150-4fc5-bedb-bea1a7ebf802 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:40.976803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:40.977465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:40.977787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:40.978067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] PATH_INFO: `/v3/users/0ee18a2053a94c46b2f3e1b973504ca1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:40.979262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee18a2053a94c46b2f3e1b973504ca1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:40.981310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:41.031140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee18a2053a94c46b2f3e1b973504ca1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.032045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee18a2053a94c46b2f3e1b973504ca1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.032653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee18a2053a94c46b2f3e1b973504ca1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.042298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee18a2053a94c46b2f3e1b973504ca1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.054652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-81b5e6b0-5aab-4f65-8d20-e0cfecdf36a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee18a2053a94c46b2f3e1b973504ca1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.074366 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 917/1813] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:40 2022] DELETE /identity/v3/users/0ee18a2053a94c46b2f3e1b973504ca1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:41.374784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:41.376360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:41.391158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9dd-0bda-41a1-867f-5680bcc0fd85 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:41.451100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:41.451837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:41.452125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:41.452403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] PATH_INFO: `/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:41.453626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d27d58eb4c45c5b66c673cb46bb4e0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:41.455645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:41.509837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d27d58eb4c45c5b66c673cb46bb4e0', 'request_id': 'req-94f1b21a-96a4-4f6a-8632-cd72312f43be'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.516355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d27d58eb4c45c5b66c673cb46bb4e0', 'request_id': 'req-94f1b21a-96a4-4f6a-8632-cd72312f43be'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.522153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d27d58eb4c45c5b66c673cb46bb4e0', 'request_id': 'req-94f1b21a-96a4-4f6a-8632-cd72312f43be'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.538191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] The token cache is being invalidate because project 92d27d58eb4c45c5b66c673cb46bb4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:41.538468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.539319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94f1b21a-96a4-4f6a-8632-cd72312f43be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:41.541329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 897/1814] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:41 2022] DELETE /identity/v3/projects/92d27d58eb4c45c5b66c673cb46bb4e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:41.549068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:41.549359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:41.549651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:41.565498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:41.572259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:41.573908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:41.676671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 918/1815] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:41.685270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:41.685809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:41.686003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:41.744927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:41.748132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:41.769937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 898/1816] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:41.770281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:41.785260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70e70-f7ae-4a04-95a9-8c3a912d8c81 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:41.791704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:41.801289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:41.801647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:41.803163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:41.803978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:41.805742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:41.809458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:41.839963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:41.853841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 919/1817] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:41.855066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0e82e-bf8b-4d3d-bc63-5d82f11c8f0a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:41.861364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:41.862008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:41.862293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:41.862572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:41.865274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:41.866554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:41.915244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:41.921928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 899/1818] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:41 2022] POST /identity/v3/projects => generated 368 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:41.927039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1a01a-82fa-4d22-857b-29920159f601 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.025224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.026309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.026657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.027004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.029433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.031045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.077804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 920/1819] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:41 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:42.079590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.097787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac463f-48e7-48de-a4e7-2df3b9c3efe7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.103881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.104538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.104823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.107384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.108152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.109801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.112618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:42.127480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 900/1820] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:42 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:42.128035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.143318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304281a3-b540-4864-8edd-15907357aae7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.150000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.151457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.151457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.151889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.157227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.157227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380d21a-6ed0-470e-b700-8a6230840601 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.176202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.176983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 921/1821] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:42 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:42.188040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0094-2264-45ac-827c-5ade3681044f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.193392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.194338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.194714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.195091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] PATH_INFO: `/v3/projects/22564acdc0bf40d084d598198b91dd16/users/f2c6dfef25e24c79b6d06c5e2d25ea48/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.218275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22564acdc0bf40d084d598198b91dd16, user_id=f2c6dfef25e24c79b6d06c5e2d25ea48, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.224406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.260740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 901/1822] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:42 2022] PUT /identity/v3/projects/22564acdc0bf40d084d598198b91dd16/users/f2c6dfef25e24c79b6d06c5e2d25ea48/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:42.273847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.274144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.274407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.320732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] MFA Rules not processed for user `f2c6dfef25e24c79b6d06c5e2d25ea48`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:42.322083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:42.410612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 922/1823] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:42.415591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.507136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd235-8244-431e-b819-b988c6911074 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.513104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.514199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.514515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.514912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.515920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.518190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.561682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 902/1824] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:42 2022] POST /identity/v3/projects => generated 368 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:42.565465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.576548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:42.578573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.583834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:42.592593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ac5d-793d-48a6-8dec-070fafe5d5a2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.681052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204b233-dc0f-4b5f-bea2-3971a91b4985 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.686040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.686739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.686992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.687451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] PATH_INFO: `/v3/users/4c80070632114a2dbff21a7aa73517ae` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.690637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.690816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c80070632114a2dbff21a7aa73517ae)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.691674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.692150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.692604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.692719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.694044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.696556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.723846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 923/1825] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:42 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:42.727518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.739642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2715-90c4-4dfd-893f-5c159e5e90d1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.748394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.749044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.749327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.749735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.750449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.752473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.753537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c80070632114a2dbff21a7aa73517ae'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:42.762481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c80070632114a2dbff21a7aa73517ae'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:42.763312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c80070632114a2dbff21a7aa73517ae'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:42.765004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 924/1826] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:42 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:42.768793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.771435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:42.778616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c80070632114a2dbff21a7aa73517ae'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:42.781357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-997d-4906-a489-2442f7fe3251 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.787243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.787962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.788311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.788656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] PATH_INFO: `/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04/users/2fbe2c8bfb754a929646d143842fbeea/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.794314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-94df96d6-73a2-4812-af73-38df97aa7c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c80070632114a2dbff21a7aa73517ae'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:42.804208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 903/1827] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:42 2022] DELETE /identity/v3/users/4c80070632114a2dbff21a7aa73517ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:42.806501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.806808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.807081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.807203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c4c7abb4734c3ab41b340198c3cc04, user_id=2fbe2c8bfb754a929646d143842fbeea, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.809889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.825823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 925/1828] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:42 2022] PUT /identity/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04/users/2fbe2c8bfb754a929646d143842fbeea/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:42.828682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:42.829991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.830618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:42.831742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:42.906816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 904/1829] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:42.913732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.915208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d73418-2c2d-4d21-9e17-5d43f05072f2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.915330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:42.920341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.921100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.921383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.922009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.922946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.925072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.940110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 926/1830] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:42 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:42.942008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:42.954711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815bb21-d34a-471f-9ceb-9c3853d60468 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.960595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:42.961296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.961585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.961866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] PATH_INFO: `/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04/users/2fbe2c8bfb754a929646d143842fbeea/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:42.966705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c4c7abb4734c3ab41b340198c3cc04, user_id=2fbe2c8bfb754a929646d143842fbeea, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:42.970122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da216ef-3283-48ad-92ee-4286a6bdf71b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:42.982371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 927/1831] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:42 2022] PUT /identity/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04/users/2fbe2c8bfb754a929646d143842fbeea/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:42.983600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949616ad-11ee-4679-9ff4-8dfa6853a98e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:42.994332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:42.994627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:42.994906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:43.034627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] MFA Rules not processed for user `2fbe2c8bfb754a929646d143842fbeea`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:43.036063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:43.037774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:43.038451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:43.038738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:43.039014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:43.073876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:43.101461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:43.135828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:43.137688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:43.152768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 928/1832] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:43.154974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 905/1833] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:43.177954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:43.188612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:43.302272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e056e-1fb1-4631-8089-bac58cff054b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:43.308823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:43.309842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:43.310138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:43.310409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:43.322661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:43.324419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:43.336249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 929/1834] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:43.472057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:43.474443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:43.497248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc43cb-4fd8-477d-ba8a-24ab0f0024e2 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:43.503907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:43.504941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:43.505689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:43.506347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:43.508982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:43.649718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:43.652744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26046035-922d-4db3-a223-f3ac5286d614 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:43.676167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 906/1835] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:43.957932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:43.960038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:43.989746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbfb6-f36e-4e79-8fe9-5ab8fceb4964 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:43.990412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbfb6-f36e-4e79-8fe9-5ab8fceb4964 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:43.990509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbfb6-f36e-4e79-8fe9-5ab8fceb4964 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:43.992697 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a215ce-fec3-4a3b-afd8-d2f3ea62d094 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:43.997737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:43.997891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 907/1836] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:44:43 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:44:43.998745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:43.999199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:43.999806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] PATH_INFO: `/v3/projects/03d5c74a9f3d4b71a14b35728a3efbda` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.001205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d5c74a9f3d4b71a14b35728a3efbda)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:44.003546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:44.058584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:44.058970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:44.059313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.105818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:44.107498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d5c74a9f3d4b71a14b35728a3efbda', 'request_id': 'req-f1fe847c-b33b-4378-9491-643833c411e9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.108205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:44.118000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d5c74a9f3d4b71a14b35728a3efbda', 'request_id': 'req-f1fe847c-b33b-4378-9491-643833c411e9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.138178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d5c74a9f3d4b71a14b35728a3efbda', 'request_id': 'req-f1fe847c-b33b-4378-9491-643833c411e9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.173410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] The token cache is being invalidate because project 03d5c74a9f3d4b71a14b35728a3efbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:44.173792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.176568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.182909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 930/1837] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:43 2022] DELETE /identity/v3/projects/03d5c74a9f3d4b71a14b35728a3efbda => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:44.184124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:44.186826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:44.270784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:44.301380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe847c-b33b-4378-9491-643833c411e9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:44.315613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:44.315613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:44.315613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:44.315613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] PATH_INFO: `/v3/users/1e626bdeae22450aa88f7063b826d6d3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.317520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e626bdeae22450aa88f7063b826d6d3)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:44.321286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:44.348334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 908/1838] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:44.396288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e626bdeae22450aa88f7063b826d6d3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.397046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e626bdeae22450aa88f7063b826d6d3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.398368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e626bdeae22450aa88f7063b826d6d3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.409370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e626bdeae22450aa88f7063b826d6d3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.418683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e626bdeae22450aa88f7063b826d6d3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.438861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 931/1839] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:44 2022] DELETE /identity/v3/users/1e626bdeae22450aa88f7063b826d6d3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:44.592716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:44.594191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:44.607879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29f9b-16b0-4f61-8836-e1eab883bd4e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:44.687253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:44.687968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:44.688672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:44.688959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] PATH_INFO: `/v3/users/13514475ac0c49818626bb43adfa8339` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.690183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13514475ac0c49818626bb43adfa8339)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:44.692876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:44.721059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:44.768141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13514475ac0c49818626bb43adfa8339'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.783450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13514475ac0c49818626bb43adfa8339'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.784344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13514475ac0c49818626bb43adfa8339'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.793453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13514475ac0c49818626bb43adfa8339'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.807560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:44.809094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:44.810221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e88f7a8-3b6c-42c7-983d-266d89e30b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13514475ac0c49818626bb43adfa8339'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:44.823460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 909/1840] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:44 2022] DELETE /identity/v3/users/13514475ac0c49818626bb43adfa8339 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:44.825037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02feb8-ea0d-473b-a98c-1b54daac0ea5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:44.828068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:44.828585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:44.829120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.852171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:44.853586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:44.899238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:44.900265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:44.900618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:44.900970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] PATH_INFO: `/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:44.902707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5da29d40ff4bb6a32a4628cea329e1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:44.904731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:44.920984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 910/1841] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:44.931083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:44.935784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.002220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5da29d40ff4bb6a32a4628cea329e1', 'request_id': 'req-0b6d47e7-2089-400d-b22a-67368f910051'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:45.011417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5da29d40ff4bb6a32a4628cea329e1', 'request_id': 'req-0b6d47e7-2089-400d-b22a-67368f910051'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:45.023320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5da29d40ff4bb6a32a4628cea329e1', 'request_id': 'req-0b6d47e7-2089-400d-b22a-67368f910051'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:45.038883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:45.046419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999a10-6197-46a3-8a28-018e96f5842d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.051153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] The token cache is being invalidate because project 4d5da29d40ff4bb6a32a4628cea329e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:45.051621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:45.054200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0b6d47e7-2089-400d-b22a-67368f910051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:45.056714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 932/1842] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:44 2022] DELETE /identity/v3/projects/4d5da29d40ff4bb6a32a4628cea329e1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:45.067052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.067052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.067052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.091735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:45.093440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.115498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.116159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.116437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.116720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.123701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.134133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:45.213769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 933/1843] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:45.217285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.218772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.229660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.231178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cd573-27b4-4094-8bdb-706a38d5d135 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.245573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 911/1844] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:45.247245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.247568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.247854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.278105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:45.279486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.305085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 912/1845] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:45.309353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.344367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654246a2-0c3f-4d2e-bd13-e180fff2505e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.362146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.365202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.365437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.365571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.366304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:45.366622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.376031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.393891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8fcc3-1025-4357-9f44-fe6823290619 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.413807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.415946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.416892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.416892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.431579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 913/1846] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:44:45.438132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.439687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.464419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9e87-7e3f-4712-b591-4183be4fc7c5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.467434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.469098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.478555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.480054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.480921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.481227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.483405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.486387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.505049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 934/1847] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:45.550810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 914/1848] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:45 2022] POST /identity/v3/projects => generated 378 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:45.556849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.575217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596510-267d-49ea-a3c6-a3064a001af4 service nova] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.664687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.665427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.665718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.666191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.668473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.671317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.702960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 935/1849] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:45 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:45.704534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.719234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597864-3837-4f53-8761-a65334e90c37 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.727466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.728205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.728550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.728838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.729802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.731785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.749117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 915/1850] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:45 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:45.755639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.798868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d5f6-d1d0-4212-b818-5e73db371ce7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.818510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.819180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.819679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.819963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.820346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.820701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.822472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.822692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:45.853733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 936/1851] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:45 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:45.858533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:45.865518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e646423-60b7-408c-b30d-d033a3535bb0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.871952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:45.894380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cff48-14e9-4cee-ad0e-79ff32d4e7c7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:45.898522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.901583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.902309 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.902823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] PATH_INFO: `/v3/projects/ccd7ac06c27243dd92e2156e2715336e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.911659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:45.912526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:45.916184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:45.926084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd7ac06c27243dd92e2156e2715336e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.927744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] PATH_INFO: `/v3/projects/e4aa6bad485d475d9726919f39dcdc07/users/e92be662b5eb4c9f8cf412c0745d0105/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:45.928601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:45.952675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4aa6bad485d475d9726919f39dcdc07, user_id=e92be662b5eb4c9f8cf412c0745d0105, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:45.959860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754741-46db-433c-a286-9f3f4e5861d2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.003241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 937/1852] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:45 2022] PUT /identity/v3/projects/e4aa6bad485d475d9726919f39dcdc07/users/e92be662b5eb4c9f8cf412c0745d0105/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:46.014377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.014675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.015401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.044284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd7ac06c27243dd92e2156e2715336e', 'request_id': 'req-3b78695a-820c-4f2e-948d-a7726046e17c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:46.053204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] MFA Rules not processed for user `e92be662b5eb4c9f8cf412c0745d0105`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:46.054635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.055166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd7ac06c27243dd92e2156e2715336e', 'request_id': 'req-3b78695a-820c-4f2e-948d-a7726046e17c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:46.062129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd7ac06c27243dd92e2156e2715336e', 'request_id': 'req-3b78695a-820c-4f2e-948d-a7726046e17c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:46.077510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] The token cache is being invalidate because project ccd7ac06c27243dd92e2156e2715336e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:46.077906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:46.078874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3b78695a-820c-4f2e-948d-a7726046e17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:46.081152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 916/1853] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:45 2022] DELETE /identity/v3/projects/ccd7ac06c27243dd92e2156e2715336e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:46.088614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82511a5-f27c-4ed8-b49a-f9213214dd5b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.089018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82511a5-f27c-4ed8-b49a-f9213214dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.089217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82511a5-f27c-4ed8-b49a-f9213214dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.110889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c82511a5-f27c-4ed8-b49a-f9213214dd5b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:46.112301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c82511a5-f27c-4ed8-b49a-f9213214dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.148781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:46.163479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 938/1854] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:46.168337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.169958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.203580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 917/1855] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:46.207876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.208173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.208546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.240513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:46.242111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.248932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e1d48-26db-4fcb-977f-abf70fbca842 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.251923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 918/1856] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:46.256076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.256995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.257191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.257725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.258154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.258977 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.261406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.268111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618a7f-e475-4759-8b43-2bed1a692b0d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.273535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.274250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.274591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.274925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.276561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:46.276945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.279979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.300231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 919/1857] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:46.301915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.314010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 939/1858] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/projects => generated 378 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:46.316180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c813f-9853-49c5-b387-5eb154900e3a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.320229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.407973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.409145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.409591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.409939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.410817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.413110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.437940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:46.446553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73122a-1849-44a8-be52-d07f337ec514 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.452707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 920/1859] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/projects => generated 378 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:46.454694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.548583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.548896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.549145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.549426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.550109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.557732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.564819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c764ae-6cd1-4bba-8eb7-1663dc441328 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.581794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.584938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.586785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.587244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.588020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.593611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.603900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 940/1860] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:46.604233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.616533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd6ab1-6aba-4569-b0d8-6b576093fbd2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.623146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.624257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.624526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.624861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.625833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.627525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.634694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 921/1861] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:46.636175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.649315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 941/1862] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:46 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:46.649488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0fc04-d812-4f9b-8588-c153247caa01 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.651623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.659297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.660688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.661049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.661403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.662286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.664595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378657a-d2fb-48eb-b105-4f336a3fe406 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.664977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.670502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.670684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.670971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.671250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.671984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.673752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.677195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 922/1863] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:46 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:46.681772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.688585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 942/1864] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:46 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:46.693156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.696239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc7e6e-a994-4b5e-8f6c-1210efe807f7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.701269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.701722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.702085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.702274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.702985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.704639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.708699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7eea-2d09-4823-8511-31c6dcd1df29 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.714504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.715238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.715564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.715839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] PATH_INFO: `/v3/projects/9fd6c16e3c9c4747ae226abb0fc69e5b/users/bb4fc9cdbf8f46a9a9bb7c12d8a88094/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.721763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 923/1865] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:46 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:46.722985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.730038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:46.735399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189de36-217a-4077-816f-bf73c6e7fea4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:46.738830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd6c16e3c9c4747ae226abb0fc69e5b, user_id=bb4fc9cdbf8f46a9a9bb7c12d8a88094, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.742360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734616-66af-4dbf-9aea-6b7c8c26e564 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.743763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:46.744541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.745057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.745412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] PATH_INFO: `/v3/projects/8ea1c2686226403a861031bc55bf6bc2/users/ebfafbb271884d139f995be120579bfb/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.759624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 943/1866] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:46 2022] PUT /identity/v3/projects/9fd6c16e3c9c4747ae226abb0fc69e5b/users/bb4fc9cdbf8f46a9a9bb7c12d8a88094/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:46.769343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea1c2686226403a861031bc55bf6bc2, user_id=ebfafbb271884d139f995be120579bfb, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:46.769837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.770193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.770542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.772604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86917dc0-6fa1-467b-8132-e6070dbdb7ea admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:46.787999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 924/1867] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:46 2022] PUT /identity/v3/projects/8ea1c2686226403a861031bc55bf6bc2/users/ebfafbb271884d139f995be120579bfb/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:46.799694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:46.800009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:46.800252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:46.805735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] MFA Rules not processed for user `bb4fc9cdbf8f46a9a9bb7c12d8a88094`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:46.806972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.830180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] MFA Rules not processed for user `ebfafbb271884d139f995be120579bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:46.831642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:46.906157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 944/1868] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:46.911191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:46.925164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 925/1869] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:46.928018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.007039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:47.050762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4749-5cd1-4746-93b4-167ce4b7f63a None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.056585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.058672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.058993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.059390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.060190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.063779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.107766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a04f-154b-4544-a4e3-1a9a7623ca60 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.119593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.120686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.121141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.121495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.122363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.125602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 945/1870] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/projects => generated 380 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:47.126012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.127919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.167744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 926/1871] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:46 2022] POST /identity/v3/projects => generated 378 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:47.172104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.251708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:47.256903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7b65-ffde-4c6c-85d2-0754b2557d1f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.257569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaa12b-0caa-428d-9eb7-e528aab2ebec admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.263980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.264343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.264778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.265127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.265219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.265409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.265500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.266214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.266317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.266923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.270684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.270907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.298023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 946/1872] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:47.302664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.304744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 927/1873] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:47.305763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.319480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3a10b-4443-472d-a9f0-712706df4512 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.324645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.325366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.325647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.325924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.326033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b532-9288-4f5b-8912-95794ef29bd1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.326689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.328705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.332740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.336357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.336709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.337086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.337866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.339864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.344857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 928/1874] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:47 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:47.350460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.358432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 947/1875] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:47 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:47.362953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.368835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbcea6-8ac5-4f57-b482-837f5ff9f8c5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.374632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.375627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.376217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.376704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.376827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac51e-b6c0-4132-a2a0-97ddf8978bb4 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.378216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.380562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.388733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.390138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.390429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.390740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] PATH_INFO: `/v3/projects/866726aae35948dab373396818b73464/users/d6ec83a7b6a24c90ac5d74109f90a7d0/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.410713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 929/1876] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:47 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:47.414045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.430456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16677-0acb-42fb-904f-05b372fb1648 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.438250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.439288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.439438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.439675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] PATH_INFO: `/v3/projects/5d2c971e9ffa47e1bacbd4e3988a1f90/users/2c88b41a0181459baed350b9158b8b25/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.442616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=866726aae35948dab373396818b73464, user_id=d6ec83a7b6a24c90ac5d74109f90a7d0, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.447536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.477102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 948/1877] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:47 2022] PUT /identity/v3/projects/866726aae35948dab373396818b73464/users/d6ec83a7b6a24c90ac5d74109f90a7d0/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:47.479963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2c971e9ffa47e1bacbd4e3988a1f90, user_id=2c88b41a0181459baed350b9158b8b25, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.482746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98ad2a-31c4-4958-8e14-c7215ac6328c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.486216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.501813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 930/1878] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:47 2022] PUT /identity/v3/projects/5d2c971e9ffa47e1bacbd4e3988a1f90/users/2c88b41a0181459baed350b9158b8b25/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:47.518262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.518556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.518840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.555825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] MFA Rules not processed for user `2c88b41a0181459baed350b9158b8b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:47.556969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:47.629217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534053b-38c0-4524-ad8d-ed033a3bd34d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.667286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:47.698607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 931/1879] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:47.703439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.729822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.730471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.730754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.731029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.731788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.733778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.747398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 949/1880] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:47 2022] GET /identity/v3/roles => generated 1427 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:47.750624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.772451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e482-4691-4ca2-8530-98c5d3ccd170 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.778724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.780164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.780624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.781311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] PATH_INFO: `/v3/projects/866726aae35948dab373396818b73464/users/d6ec83a7b6a24c90ac5d74109f90a7d0/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.785176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=866726aae35948dab373396818b73464, user_id=d6ec83a7b6a24c90ac5d74109f90a7d0, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.800349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464918-fbe7-4f97-935a-0ee52568d72e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.810108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b879d-6a98-46fb-a1ba-487093878b32 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:47.818761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:47.819555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.819887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.820167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.820846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:47.821580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 950/1881] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:47 2022] PUT /identity/v3/projects/866726aae35948dab373396818b73464/users/d6ec83a7b6a24c90ac5d74109f90a7d0/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:47.833290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:47.842263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:47.843683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:47.843980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:47.874631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 932/1882] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/projects => generated 376 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:47.879037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:47.884831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] MFA Rules not processed for user `d6ec83a7b6a24c90ac5d74109f90a7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:47.886040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:47.911101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:47.985589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 951/1883] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:48.001638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.003292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:48.011567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eaad2-f2a2-4a22-9993-2244faefdaf7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.017902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.018616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.018917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.019193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.019951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.022570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.058926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 933/1884] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:47 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:48.058926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.075889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246d945-018d-423b-bbdc-2b7770984911 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.078739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123ec0a-e530-4c24-9a57-d5a737c42c98 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.081793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.082714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.082916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.083037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.083778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.083982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.084083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.084393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.084952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.086635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.095631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.097272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.110760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 934/1885] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:48 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:48.110760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.111389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 952/1886] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:48.130888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03980802-a7fb-4dfd-bf57-9383b2f9b139 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.137987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.139034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.139572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.140247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] PATH_INFO: `/v3/projects/247d868535a24e69b5a467b39529beb1/users/6d54116c4b7f46118373bfcad5921cd2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.163608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=247d868535a24e69b5a467b39529beb1, user_id=6d54116c4b7f46118373bfcad5921cd2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.166101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.173616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.177075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ff55-0601-497f-93d9-6de9f536aac1 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.201915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.202644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.202929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.203256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.208229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 935/1887] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:48 2022] PUT /identity/v3/projects/247d868535a24e69b5a467b39529beb1/users/6d54116c4b7f46118373bfcad5921cd2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:48.212235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.256728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:48.291817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc280-fbcd-4f72-8cc9-aa6ca111a6ca admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.299700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.301478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.301981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.302441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.302845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.303281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.304609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.305827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7508445-8c75-4229-ba90-49390db05687 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.318108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 953/1888] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:48.321286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 936/1889] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:48 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:48.334258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.355584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acceea-9145-4d7e-97a8-c09fc4d0d9ef service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.364492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.365872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.366885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.367522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] PATH_INFO: `/v3/projects/247d868535a24e69b5a467b39529beb1/users/6d54116c4b7f46118373bfcad5921cd2/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.370811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247d868535a24e69b5a467b39529beb1, user_id=6d54116c4b7f46118373bfcad5921cd2, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.375226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.389494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 954/1890] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:48 2022] PUT /identity/v3/projects/247d868535a24e69b5a467b39529beb1/users/6d54116c4b7f46118373bfcad5921cd2/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:48.402343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a31e89-1956-420b-850c-9735c60c44da None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.402661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a31e89-1956-420b-850c-9735c60c44da None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.403011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a31e89-1956-420b-850c-9735c60c44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.444609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-98a31e89-1956-420b-850c-9735c60c44da None None] MFA Rules not processed for user `6d54116c4b7f46118373bfcad5921cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:48.446241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-98a31e89-1956-420b-850c-9735c60c44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:48.526417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:48.572983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 937/1891] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:48.686016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:48.751965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d132-775b-4438-8588-fd4592e76fda None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.752760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d132-775b-4438-8588-fd4592e76fda None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.753207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d132-775b-4438-8588-fd4592e76fda None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.754753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 938/1892] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:44:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 05 20:44:48.777345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.777863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.778254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.786171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8fd7-19d3-4127-876a-ff9e87f19306 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:48.791906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:48.792732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:48.794227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:48.794719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:48.826027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:48.829631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:48.909560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:48.911262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:48.946203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 955/1893] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:49.034172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 939/1894] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:44:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:49.049123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:49.050825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:49.078197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ddc0-9c3d-4a23-a15d-90e3b4d38e99 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:49.085351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:49.086086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:49.086500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:49.086859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:49.098322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:49.099675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09b8a4-0ff4-4c4d-a7f1-c5f5229ec0c8 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:49.118780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 956/1895] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:52.499336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:52.501264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:52.601762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff32d55-db25-4edb-81bd-a1181ec6b563 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:52.611150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:52.612095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:52.612530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:52.613022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] PATH_INFO: `/v3/users/f2c6dfef25e24c79b6d06c5e2d25ea48` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:52.614483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c6dfef25e24c79b6d06c5e2d25ea48)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:52.617713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:52.711524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c6dfef25e24c79b6d06c5e2d25ea48'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:52.720496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c6dfef25e24c79b6d06c5e2d25ea48'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:52.721658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c6dfef25e24c79b6d06c5e2d25ea48'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:52.740639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c6dfef25e24c79b6d06c5e2d25ea48'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:52.760120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c6dfef25e24c79b6d06c5e2d25ea48'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:52.762749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:52.768874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 940/1896] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:52 2022] DELETE /identity/v3/users/f2c6dfef25e24c79b6d06c5e2d25ea48 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:52.774012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:52.774524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:52.774769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:52.796707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:52.798384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:52.833961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:52.836013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:52.861819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:52.883701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 957/1897] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:52.885202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:52.886844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:52.916681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9c262-3223-4ec9-9cdc-b027079eac54 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:52.920787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:52.921490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:52.921889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:52.922444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:52.923909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:52.950601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d78cd-4d8f-492d-9abd-a52e7097422f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:52.955247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:52.955992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:52.956347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:52.956691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:52.976444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:52.978408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:52.990064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 958/1898] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:52.998050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:52.999735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:53.009226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 941/1899] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:44:53.389675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:53.391130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:53.407245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f078-2226-4057-8a76-bdeccb4f9283 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:53.413609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:53.414315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:53.414597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:53.414876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] PATH_INFO: `/v3/projects/22564acdc0bf40d084d598198b91dd16` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:53.416192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22564acdc0bf40d084d598198b91dd16)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:53.418209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:53.489758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22564acdc0bf40d084d598198b91dd16', 'request_id': 'req-0ae4ff34-d811-4d67-91b9-165d09a63d1c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.497735 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22564acdc0bf40d084d598198b91dd16', 'request_id': 'req-0ae4ff34-d811-4d67-91b9-165d09a63d1c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.506577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22564acdc0bf40d084d598198b91dd16', 'request_id': 'req-0ae4ff34-d811-4d67-91b9-165d09a63d1c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.526688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] The token cache is being invalidate because project 22564acdc0bf40d084d598198b91dd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:53.527042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.527668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.531678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 959/1900] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:53 2022] DELETE /identity/v3/projects/22564acdc0bf40d084d598198b91dd16 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:53.536365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:53.550404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeadf8d-1e5c-471b-bcbb-5c387c5bbc6c service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:53.633895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:53.634884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:53.635268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:53.635712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] PATH_INFO: `/v3/users/2fbe2c8bfb754a929646d143842fbeea` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:53.637179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbe2c8bfb754a929646d143842fbeea)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:53.639315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:53.711241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbe2c8bfb754a929646d143842fbeea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.721251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbe2c8bfb754a929646d143842fbeea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.723190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbe2c8bfb754a929646d143842fbeea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.726100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:53.734800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbe2c8bfb754a929646d143842fbeea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.784990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbe2c8bfb754a929646d143842fbeea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:53.805841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 942/1901] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:53 2022] DELETE /identity/v3/users/2fbe2c8bfb754a929646d143842fbeea => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:53.887382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:53.888930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:53.992483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:53.994700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.022600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4ff34-d811-4d67-91b9-165d09a63d1c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.107069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:54.138941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.139938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.140434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.140886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.145098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.148999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3b44-ce56-4b07-a5ca-b8c510e02695 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.159949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.160632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.160915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.161190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] PATH_INFO: `/v3/users/e92be662b5eb4c9f8cf412c0745d0105` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.168314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92be662b5eb4c9f8cf412c0745d0105)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.174403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.281910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.282354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92be662b5eb4c9f8cf412c0745d0105'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.284651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.292833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92be662b5eb4c9f8cf412c0745d0105'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.293604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92be662b5eb4c9f8cf412c0745d0105'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.300408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 960/1902] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:54.301309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:54.302897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.319280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92be662b5eb4c9f8cf412c0745d0105'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.319670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7b145-052d-41d5-810d-8245a6238672 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.335968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-20d8f6c9-c96a-41b7-bd2c-bea5cdd5aea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92be662b5eb4c9f8cf412c0745d0105'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.343861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 943/1903] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:53 2022] DELETE /identity/v3/users/e92be662b5eb4c9f8cf412c0745d0105 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:54.348223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b03-4a37-4c0b-aca4-5ce223e7495f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.348497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b03-4a37-4c0b-aca4-5ce223e7495f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.348794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b03-4a37-4c0b-aca4-5ce223e7495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.362564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.363243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.363550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.363831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] PATH_INFO: `/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.366298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c4c7abb4734c3ab41b340198c3cc04)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.368509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.377623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-284f7b03-4a37-4c0b-aca4-5ce223e7495f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:54.379251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-284f7b03-4a37-4c0b-aca4-5ce223e7495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.485350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c4c7abb4734c3ab41b340198c3cc04', 'request_id': 'req-2370b786-7195-46c4-9045-6d1eaf660b67'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.509085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c4c7abb4734c3ab41b340198c3cc04', 'request_id': 'req-2370b786-7195-46c4-9045-6d1eaf660b67'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.516289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c4c7abb4734c3ab41b340198c3cc04', 'request_id': 'req-2370b786-7195-46c4-9045-6d1eaf660b67'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.525708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:54.555305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] The token cache is being invalidate because project e5c4c7abb4734c3ab41b340198c3cc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:54.555632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.559809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 944/1904] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:54.560311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:54.560311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 961/1905] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:54 2022] DELETE /identity/v3/projects/e5c4c7abb4734c3ab41b340198c3cc04 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:54.566368 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d948b-7ae1-493f-ab74-7eae082095d5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.566663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d948b-7ae1-493f-ab74-7eae082095d5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.566924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d948b-7ae1-493f-ab74-7eae082095d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.571504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:54.575027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.593994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-975d948b-7ae1-493f-ab74-7eae082095d5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:54.595396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-975d948b-7ae1-493f-ab74-7eae082095d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.656196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370b786-7195-46c4-9045-6d1eaf660b67 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.676252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.678336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.679933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.680434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.683736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.728436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:54.764952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 945/1906] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:54.766251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.766545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.766827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.788619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.790418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.791616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:54.792979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:54.802410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 946/1907] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:54.804664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 962/1908] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:54.806250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:54.816496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5036-85b3-45b8-a3dd-f36d5434b2f6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.822882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.823569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.823857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.824137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.824893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:54.825205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.827015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.840433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 947/1909] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:54.844936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:54.856832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443865-7bc8-4e97-b8ee-0bb89d5991cd service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:54.864469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:54.868224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:54.868673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:54.869092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:54.869947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:54.872337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:54.921595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 963/1910] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:54 2022] POST /identity/v3/projects => generated 388 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:44:54.925693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:54.939753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ebff6-503b-4351-908d-c9e801d5b3fc admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.051192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.053563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.054043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.054652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.055590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.058101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.089614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 948/1911] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:54 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:55.090989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.107665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f933-25fd-41c5-9c5d-f8fc0fd53edc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.114966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.116222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.116513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.116793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.118044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.120779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.155416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 964/1912] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:55 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:55.159475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.176331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9d9dd-5817-431f-a71e-1ee52d1ca020 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.183508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.185044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.185818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.186193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.186536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.186770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.187468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.189567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.203667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4212b6-1c80-46ee-9073-17feaf9deb56 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.204515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 949/1913] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:55 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:55.207766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.211726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.212633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.213482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.213834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] PATH_INFO: `/v3/users/8e1d00d8b46649bf941b75a6bd6c40dc` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.215258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1d00d8b46649bf941b75a6bd6c40dc)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.217753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.223005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a32ea2-78fe-401c-bf20-c20ce90b523d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.230905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.232133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.232630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.233087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] PATH_INFO: `/v3/projects/c396c71d80de46a5a4e4df37033b2d97/users/b01b6cc0c792480aa418490f4f70d8ac/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.259251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c396c71d80de46a5a4e4df37033b2d97, user_id=b01b6cc0c792480aa418490f4f70d8ac, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.264455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122d21-510b-4e5a-9697-77ed1ad78bf8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.280285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1d00d8b46649bf941b75a6bd6c40dc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.281021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1d00d8b46649bf941b75a6bd6c40dc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.282663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1d00d8b46649bf941b75a6bd6c40dc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.286948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 950/1914] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:55 2022] PUT /identity/v3/projects/c396c71d80de46a5a4e4df37033b2d97/users/b01b6cc0c792480aa418490f4f70d8ac/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:55.293519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1d00d8b46649bf941b75a6bd6c40dc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.299514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.299812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.300094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.304509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7dce8ed8-a8e7-4b9c-8401-04b876311dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1d00d8b46649bf941b75a6bd6c40dc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.354233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] MFA Rules not processed for user `b01b6cc0c792480aa418490f4f70d8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:55.355746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.357599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 965/1915] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:55 2022] DELETE /identity/v3/users/8e1d00d8b46649bf941b75a6bd6c40dc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:55.362865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.363161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.363486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.401937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:55.403341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:55.403842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.489423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 966/1916] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:55.493544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.495077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.504236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:55.511543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 951/1917] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:55.516168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.519437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.523270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b072e6-8c25-43fc-a3fd-63c7aacddd21 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.555150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.555883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.556185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.556849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] PATH_INFO: `/v3/projects/e4aa6bad485d475d9726919f39dcdc07` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.559593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4aa6bad485d475d9726919f39dcdc07)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.561611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.608339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5299b-e681-421a-8edb-c7fa30495fc3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.614463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.615618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.616085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.616514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.627491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.628982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.641045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 952/1918] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:55.641984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.643479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.657741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4aa6bad485d475d9726919f39dcdc07', 'request_id': 'req-98f4cd13-ca32-43a1-a909-652c4c7edff3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.659042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31375-5503-4fb5-b7b2-503976ac4882 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.674634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4aa6bad485d475d9726919f39dcdc07', 'request_id': 'req-98f4cd13-ca32-43a1-a909-652c4c7edff3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.689518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4aa6bad485d475d9726919f39dcdc07', 'request_id': 'req-98f4cd13-ca32-43a1-a909-652c4c7edff3'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.717750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] The token cache is being invalidate because project e4aa6bad485d475d9726919f39dcdc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:55.718065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.718802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.722042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 967/1919] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:55 2022] DELETE /identity/v3/projects/e4aa6bad485d475d9726919f39dcdc07 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:55.726615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.729029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.760859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.762005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.762296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.762572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.763944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.766169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.827150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4cd13-ca32-43a1-a909-652c4c7edff3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:55.833922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 953/1920] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:55 2022] POST /identity/v3/projects => generated 388 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:55.835874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:55.840613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:55.843819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:55.844505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:55.844805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:55.845065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] PATH_INFO: `/v3/users/bb4fc9cdbf8f46a9a9bb7c12d8a88094` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:55.846329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4fc9cdbf8f46a9a9bb7c12d8a88094)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:55.850399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:55.944570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:55.969338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4fc9cdbf8f46a9a9bb7c12d8a88094'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.970178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4fc9cdbf8f46a9a9bb7c12d8a88094'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.970874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4fc9cdbf8f46a9a9bb7c12d8a88094'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.985481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4fc9cdbf8f46a9a9bb7c12d8a88094'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:55.997836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4fc9cdbf8f46a9a9bb7c12d8a88094'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.000203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de296-27b6-4f8f-bc26-b19706727ec0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.012174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.013140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.013479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.013927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.014802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.017023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.033807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 968/1921] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:55 2022] DELETE /identity/v3/users/bb4fc9cdbf8f46a9a9bb7c12d8a88094 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:56.062605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 954/1922] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:55 2022] POST /identity/v3/users => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:56.066560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.068832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.079073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:56.134622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.136744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.152453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3241-e645-454f-944b-aebc0cd0ecb5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.152879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddcc54-d603-4509-b46a-1ce4489e89c9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.163438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.164751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.165426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.165876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.166153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.166541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.167263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.168718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.169001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] PATH_INFO: `/v3/projects/26b6e50ce5314ed58c0960d0df5e7896` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.170180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.171209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b6e50ce5314ed58c0960d0df5e7896)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.174514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.197257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 969/1923] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:56 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:56.203333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.218802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7287-07a7-4b1c-97ab-830af7f3f7f7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.226611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.227388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.227701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.227963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] PATH_INFO: `/v3/projects/e87012e43428447f862b3523945affb1/users/f86f497f6883485c84c6ebfb1c2fc7cc/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.247146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87012e43428447f862b3523945affb1, user_id=f86f497f6883485c84c6ebfb1c2fc7cc, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.249025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.256017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b6e50ce5314ed58c0960d0df5e7896', 'request_id': 'req-46988a8a-ac5a-4e04-965f-aa1d6650fd46'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.264606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 970/1924] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:56 2022] PUT /identity/v3/projects/e87012e43428447f862b3523945affb1/users/f86f497f6883485c84c6ebfb1c2fc7cc/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:56.267921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b6e50ce5314ed58c0960d0df5e7896', 'request_id': 'req-46988a8a-ac5a-4e04-965f-aa1d6650fd46'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.268834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.275851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b6e50ce5314ed58c0960d0df5e7896', 'request_id': 'req-46988a8a-ac5a-4e04-965f-aa1d6650fd46'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.292186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] The token cache is being invalidate because project 26b6e50ce5314ed58c0960d0df5e7896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:56.292482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.293144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.294734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 955/1925] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:56 2022] DELETE /identity/v3/projects/26b6e50ce5314ed58c0960d0df5e7896 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:56.298781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.300794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.375053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064845-6df9-467f-8351-30e786928a8e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.388541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.389998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.390673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.391191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.392177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.397021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.433409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 971/1926] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:56 2022] GET /identity/v3/roles => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:56.441084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.448547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.456889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46988a8a-ac5a-4e04-965f-aa1d6650fd46 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.465075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.465624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e2aad-931e-4d10-b2c9-db654290e1df admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.465771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.466048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.466329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] PATH_INFO: `/v3/users/9344e2d69ca04f1ba5ebd57eb4802f11` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.467700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9344e2d69ca04f1ba5ebd57eb4802f11)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.469733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.470640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.471331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.472013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.472295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] PATH_INFO: `/v3/projects/e87012e43428447f862b3523945affb1/users/f86f497f6883485c84c6ebfb1c2fc7cc/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.475476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87012e43428447f862b3523945affb1, user_id=f86f497f6883485c84c6ebfb1c2fc7cc, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.478547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ba698-2ed6-44fd-a9a0-589480c73758 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.492388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 972/1927] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:56 2022] PUT /identity/v3/projects/e87012e43428447f862b3523945affb1/users/f86f497f6883485c84c6ebfb1c2fc7cc/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:56.504259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.504554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.505400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.541260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] MFA Rules not processed for user `f86f497f6883485c84c6ebfb1c2fc7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:56.544388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9344e2d69ca04f1ba5ebd57eb4802f11'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.545736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.555584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9344e2d69ca04f1ba5ebd57eb4802f11'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.557169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9344e2d69ca04f1ba5ebd57eb4802f11'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.562283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:56.580636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9344e2d69ca04f1ba5ebd57eb4802f11'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.603666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9344e2d69ca04f1ba5ebd57eb4802f11'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:56.616497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 956/1928] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:56 2022] DELETE /identity/v3/users/9344e2d69ca04f1ba5ebd57eb4802f11 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:56.620890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:56.652853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 973/1929] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:44:56.666860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:56.668329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:56.809351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b271c7-9761-463f-a936-9643fadac620 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:56.813845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:56.814512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:56.814848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:56.815187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:56.901976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:56.903499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:56.916315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 957/1930] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:57.150949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:57.152860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:57.316073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177011e-b9c5-4733-864c-d2169eafa4d4 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:57.453453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:57.454655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:57.455301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:57.455804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] PATH_INFO: `/v3/projects/9fd6c16e3c9c4747ae226abb0fc69e5b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:57.457491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd6c16e3c9c4747ae226abb0fc69e5b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:57.460190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:57.535938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd6c16e3c9c4747ae226abb0fc69e5b', 'request_id': 'req-91537d45-e4f9-4fb2-8495-6fb36095f9d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.547309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd6c16e3c9c4747ae226abb0fc69e5b', 'request_id': 'req-91537d45-e4f9-4fb2-8495-6fb36095f9d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.556473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd6c16e3c9c4747ae226abb0fc69e5b', 'request_id': 'req-91537d45-e4f9-4fb2-8495-6fb36095f9d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.579065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] The token cache is being invalidate because project 9fd6c16e3c9c4747ae226abb0fc69e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:57.579698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.580465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.587251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 974/1931] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:57 2022] DELETE /identity/v3/projects/9fd6c16e3c9c4747ae226abb0fc69e5b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:57.589173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:57.606486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27124d78-a225-4f12-a939-746c8e800b30 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:57.704661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:57.706558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:57.713879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:57.714860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:57.715154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:57.715471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] PATH_INFO: `/v3/users/d6ec83a7b6a24c90ac5d74109f90a7d0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:57.716758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ec83a7b6a24c90ac5d74109f90a7d0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:57.718929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:57.767906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:57.803670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:57.826613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ec83a7b6a24c90ac5d74109f90a7d0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.832858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537d45-e4f9-4fb2-8495-6fb36095f9d1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:57.837582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ec83a7b6a24c90ac5d74109f90a7d0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.838318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ec83a7b6a24c90ac5d74109f90a7d0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.843678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:57.844636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:57.845084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:57.845715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] PATH_INFO: `/v3/projects/8e162037a3d54c569cf7b62bd41b6c37` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:57.847397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e162037a3d54c569cf7b62bd41b6c37)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:57.850466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:57.853298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ec83a7b6a24c90ac5d74109f90a7d0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.871112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-caea8c4b-352d-4be7-bd50-652b6b227c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ec83a7b6a24c90ac5d74109f90a7d0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.891134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 958/1932] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:57 2022] DELETE /identity/v3/users/d6ec83a7b6a24c90ac5d74109f90a7d0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:57.927070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e162037a3d54c569cf7b62bd41b6c37', 'request_id': 'req-8b4b281d-4ccd-4f64-8359-1e0c68301cef'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.933792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e162037a3d54c569cf7b62bd41b6c37', 'request_id': 'req-8b4b281d-4ccd-4f64-8359-1e0c68301cef'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.940474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e162037a3d54c569cf7b62bd41b6c37', 'request_id': 'req-8b4b281d-4ccd-4f64-8359-1e0c68301cef'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.955267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] The token cache is being invalidate because project 8e162037a3d54c569cf7b62bd41b6c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:57.955695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.956404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:57.964302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 975/1933] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:57 2022] DELETE /identity/v3/projects/8e162037a3d54c569cf7b62bd41b6c37 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:57.967694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7862-59ca-4c20-8935-7ea67aa630a1 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:57.967878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7862-59ca-4c20-8935-7ea67aa630a1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:57.968314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7862-59ca-4c20-8935-7ea67aa630a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:57.996532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-731a7862-59ca-4c20-8935-7ea67aa630a1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:57.997826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-731a7862-59ca-4c20-8935-7ea67aa630a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.079126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.081158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.086893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 959/1934] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:58.096640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.097103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.097391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.101245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b281d-4ccd-4f64-8359-1e0c68301cef admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.107173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.108028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.108313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.108597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] PATH_INFO: `/v3/users/b01b6cc0c792480aa418490f4f70d8ac` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.109939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01b6cc0c792480aa418490f4f70d8ac)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.112052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.128122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:58.129379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.144869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 960/1935] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:58.146344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.157035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9928d4-8967-4df5-a2f9-a8b72285b56e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.162544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.163212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.163933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.163933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.164460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:58.164767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.166489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.176420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01b6cc0c792480aa418490f4f70d8ac'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.177297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01b6cc0c792480aa418490f4f70d8ac'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.178099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01b6cc0c792480aa418490f4f70d8ac'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.180574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 961/1936] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:58.185730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.187875 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.192812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01b6cc0c792480aa418490f4f70d8ac'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.202444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d8f25-0559-46b7-b94e-890ea12f0d7c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.203403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9a94f9ee-2615-4755-83bb-d5e57434aed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01b6cc0c792480aa418490f4f70d8ac'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.210199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.210845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.211128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.211435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.212214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.214960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.228897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 976/1937] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:58 2022] DELETE /identity/v3/users/b01b6cc0c792480aa418490f4f70d8ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:44:58.234598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.234598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.237945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.275513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 962/1938] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/projects => generated 368 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:58.279479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.292754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:58.295833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.342063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:58.391539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e97a-cb2d-4a70-830a-e263f797360f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.406110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.407663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.408295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.408893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.409830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.420067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.437533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:58.455394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 977/1939] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:58.456259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.457637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.478184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d7db-bd90-4356-889f-aaa83a3b194f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.484027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.485299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.485863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.486289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] PATH_INFO: `/v3/projects/866726aae35948dab373396818b73464` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.487660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866726aae35948dab373396818b73464)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.489523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 963/1940] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:58.490269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.491487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.493670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.573569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866726aae35948dab373396818b73464', 'request_id': 'req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.589171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866726aae35948dab373396818b73464', 'request_id': 'req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.596802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866726aae35948dab373396818b73464', 'request_id': 'req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.616453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] The token cache is being invalidate because project 866726aae35948dab373396818b73464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:44:58.617959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.619742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:58.621581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cc92d-8966-41f9-a9c7-d7cad8774b4e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.623236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 978/1941] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:44:58 2022] DELETE /identity/v3/projects/866726aae35948dab373396818b73464 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:58.625067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.628294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.718018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.718703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.718977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.719454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.721451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.742355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333ac4c-1f7c-4a8f-9f9a-31d759826f69 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.747899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.749051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.749634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.750051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.752650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.755017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a03925-5d41-4b91-b997-82751fd99d8c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.773288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 979/1942] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:58 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:58.774576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.774867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.775143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.832054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:58.833502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.853786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.856563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30608b7a-f359-4dae-b576-7bbbd6b7f187 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.860938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 980/1943] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:58.862460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.873975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 964/1944] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:58.876445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126c3f-2dfe-4419-b05c-f2843e1961e8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.883127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.883968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.884460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.884839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.885656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.887391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.888462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.888756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.889035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.901820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 981/1945] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:58 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:58.904564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.907765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.931223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480df32-dc03-49a1-bf8d-746eb97e1f4c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:58.949409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:58.950688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:58.954565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:58.955217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:58.955717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:58.955847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] PATH_INFO: `/v3/users/ebfafbb271884d139f995be120579bfb` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:58.976460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 965/1946] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:58.976660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfafbb271884d139f995be120579bfb)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:58.976756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:58.977402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:58.996555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078699f-d514-44dd-b42e-39e1ff965728 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.004349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:59.012676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.014263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.014639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.014982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] PATH_INFO: `/v3/projects/754b38b8a306405c8057056abe262024/users/d3e7b792dc7f4c44963d857ada3a06ff/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.051957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfafbb271884d139f995be120579bfb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:59.052766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfafbb271884d139f995be120579bfb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:59.055887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfafbb271884d139f995be120579bfb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:59.057254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=754b38b8a306405c8057056abe262024, user_id=d3e7b792dc7f4c44963d857ada3a06ff, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.060096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.066601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfafbb271884d139f995be120579bfb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:59.077822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-83a627d6-f63a-4736-816a-bd9bb5d3611d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfafbb271884d139f995be120579bfb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:44:59.094551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 966/1947] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:58 2022] PUT /identity/v3/projects/754b38b8a306405c8057056abe262024/users/d3e7b792dc7f4c44963d857ada3a06ff/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:59.095559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.103182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:59.120584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 982/1948] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:44:58 2022] DELETE /identity/v3/users/ebfafbb271884d139f995be120579bfb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:59.122925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3873-e097-484a-9a13-120b2f8522e7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.125352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3873-e097-484a-9a13-120b2f8522e7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.125668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a3873-e097-484a-9a13-120b2f8522e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.187380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ed0a3873-e097-484a-9a13-120b2f8522e7 None None] MFA Rules not processed for user `d3e7b792dc7f4c44963d857ada3a06ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:59.188524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:59.188641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ed0a3873-e097-484a-9a13-120b2f8522e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:59.252429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95c70-5ec7-468c-a295-0b62e6c60d0b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.292962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 983/1949] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:59.302002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.302288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.302726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.342914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.343125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.343456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.343701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.345834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:44:59.346149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.347790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:59.348760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:59.353836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.358206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 984/1950] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:44:59.359226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.360638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:59.378502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 967/1951] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:44:59.380392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec6ed-e691-4b3d-9f05-c4d8b2d6f0ce None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.380637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.383670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:44:59.395804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.396554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.396842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.397113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.397798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.399973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.440374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 985/1952] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/projects => generated 370 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:59.440719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.468427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef46a63-fdc3-45cb-a5ee-01146c4de55a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.521272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f7d0d-dfc1-4f3c-8476-5c5fe722e0c4 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.528481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.529295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.529582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.529916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.531857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.532635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.533023 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.533392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.534200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.536730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.541216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.542789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.545725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:59.555008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 968/1953] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:44:59.555929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.568087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0fbcc-91cc-4fa1-9511-187f6bbe44b1 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.574140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.575018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.575468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.575816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.577289 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.579711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.583316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 986/1954] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/projects => generated 374 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:59.587556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.616815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 969/1955] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:59.620610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.638984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46109982-b291-4fdd-b83d-ca6c38575459 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.653648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:59.673930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8e63e-01d5-46ca-85c1-3db4c4f7ab1d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.679859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.680501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.680779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.681052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.681726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.685092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.707602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 987/1956] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:44:59.712589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.724974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d3f6-4d45-4d6d-b21d-059326f34299 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.730744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.731510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.731790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.732060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.732775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.734420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.748002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 988/1957] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:44:59.754549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.760998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.762071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.762461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.763215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.763780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d94c-e912-4360-8807-84d17eb6d4f9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.764674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.767909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.768939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.769710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.770007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.770286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.771135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.772925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.785399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 989/1958] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:59.790213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.793440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 970/1959] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:44:59.797317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.802152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2011fe8-e5e6-4f0b-b8a8-4ae7a9b76ff0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.807434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.808145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.808456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.808707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] PATH_INFO: `/v3/projects/e64ea1b6bca64d68ab2dbf0e1ea17479/users/8e83d064ea6a45e79a28d261d2d24fa4/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.815138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ab58-4594-4ed4-90a6-d2d85e429475 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:44:59.823048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:44:59.824312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.825056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.826307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] PATH_INFO: `/v3/projects/c453571bdfba4aed8428f60129bd2b78/users/1bca52cfc526413d8d54134dc5ca7a3c/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.851555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c453571bdfba4aed8428f60129bd2b78, user_id=1bca52cfc526413d8d54134dc5ca7a3c, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.857189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.867299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ea1b6bca64d68ab2dbf0e1ea17479, user_id=8e83d064ea6a45e79a28d261d2d24fa4, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:44:59.870370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5deee4-d874-4675-a3f6-ce7aa9c2d908 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:44:59.880125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 971/1960] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:59 2022] PUT /identity/v3/projects/c453571bdfba4aed8428f60129bd2b78/users/1bca52cfc526413d8d54134dc5ca7a3c/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:59.884255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:44:59.892769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 990/1961] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:44:59 2022] PUT /identity/v3/projects/e64ea1b6bca64d68ab2dbf0e1ea17479/users/8e83d064ea6a45e79a28d261d2d24fa4/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:44:59.894959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:44:59.895253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:44:59.901407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:44:59.939584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:44:59.941264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.020312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c96bba-37a3-4dcc-9040-dfe89d263001 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.048407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 991/1962] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:00.049539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.057671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.071671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b77a-6d4e-4ac3-b0f5-6fdd1a7dfe42 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.076846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.077652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.077940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.078352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] PATH_INFO: `/v3/projects/8ea1c2686226403a861031bc55bf6bc2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.079656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea1c2686226403a861031bc55bf6bc2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.081895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.096400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.097203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.097572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.097948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.099008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.101167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.115177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 972/1963] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:44:59 2022] GET /identity/v3/roles => generated 1427 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:00.116234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.126446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:00.145854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea1c2686226403a861031bc55bf6bc2', 'request_id': 'req-409db21e-cd82-498d-a59d-0122466d524a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.154619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea1c2686226403a861031bc55bf6bc2', 'request_id': 'req-409db21e-cd82-498d-a59d-0122466d524a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.163282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea1c2686226403a861031bc55bf6bc2', 'request_id': 'req-409db21e-cd82-498d-a59d-0122466d524a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.169027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:00.185584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] The token cache is being invalidate because project 8ea1c2686226403a861031bc55bf6bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:00.186035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.188482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.193833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 992/1964] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:00 2022] DELETE /identity/v3/projects/8ea1c2686226403a861031bc55bf6bc2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:00.193833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.193833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.214869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaee43-286a-4173-8fdb-59908978bcef admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.277812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.278826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.279285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.279896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.283082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.288963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db21e-cd82-498d-a59d-0122466d524a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.297337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.298153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.298505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.298852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] PATH_INFO: `/v3/projects/c453571bdfba4aed8428f60129bd2b78/users/1bca52cfc526413d8d54134dc5ca7a3c/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.301188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c453571bdfba4aed8428f60129bd2b78, user_id=1bca52cfc526413d8d54134dc5ca7a3c, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.306065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.306432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.308324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6760b1-84d5-4692-b06e-ff473132434c service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.319773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 993/1965] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:00 2022] PUT /identity/v3/projects/c453571bdfba4aed8428f60129bd2b78/users/1bca52cfc526413d8d54134dc5ca7a3c/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:00.320765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 973/1966] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:00 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:00.320869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.323847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.329777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.330063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.330340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.364446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] MFA Rules not processed for user `1bca52cfc526413d8d54134dc5ca7a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:00.366910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.459247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c922c-f003-43d7-a2c8-ecba3ab046be admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.466551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.467747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.468082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.468365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] PATH_INFO: `/v3/users/2c88b41a0181459baed350b9158b8b25` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.469721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c88b41a0181459baed350b9158b8b25)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.472544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.480773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 974/1967] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:00.496323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.498303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.543866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c88b41a0181459baed350b9158b8b25'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.544588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c88b41a0181459baed350b9158b8b25'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.545410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c88b41a0181459baed350b9158b8b25'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.549309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:00.562137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c88b41a0181459baed350b9158b8b25'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.575455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c88b41a0181459baed350b9158b8b25'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:00.599039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dfed1-5d00-4faa-b469-2bbe16918ffd None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.602676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.603321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.603635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.603940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.605719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.623632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.625095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:00.629429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 994/1968] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:00 2022] DELETE /identity/v3/users/2c88b41a0181459baed350b9158b8b25 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:00.640306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 975/1969] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:00.773079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:00.774803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:00.909238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289234ca-535e-40e9-ade2-482c532e8acb admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:00.915872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:00.916557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:00.916843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:00.919000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] PATH_INFO: `/v3/projects/c396c71d80de46a5a4e4df37033b2d97` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:00.920991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c396c71d80de46a5a4e4df37033b2d97)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:00.925727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:01.011315 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c396c71d80de46a5a4e4df37033b2d97', 'request_id': 'req-012627e4-e272-491a-a1f0-6bb31820c46c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.023566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c396c71d80de46a5a4e4df37033b2d97', 'request_id': 'req-012627e4-e272-491a-a1f0-6bb31820c46c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.034763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c396c71d80de46a5a4e4df37033b2d97', 'request_id': 'req-012627e4-e272-491a-a1f0-6bb31820c46c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.054537 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] The token cache is being invalidate because project c396c71d80de46a5a4e4df37033b2d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:01.054820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.055893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012627e4-e272-491a-a1f0-6bb31820c46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.061213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 995/1970] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:00 2022] DELETE /identity/v3/projects/c396c71d80de46a5a4e4df37033b2d97 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:01.062776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:01.079923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62fc8-17a4-406c-8fa0-72d55f87bf65 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:01.119214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:01.216373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:01.217131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:01.217368 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:01.217659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] PATH_INFO: `/v3/users/f86f497f6883485c84c6ebfb1c2fc7cc` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:01.222573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86f497f6883485c84c6ebfb1c2fc7cc)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:01.228931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:01.312458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86f497f6883485c84c6ebfb1c2fc7cc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.323908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86f497f6883485c84c6ebfb1c2fc7cc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.324666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86f497f6883485c84c6ebfb1c2fc7cc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.352723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86f497f6883485c84c6ebfb1c2fc7cc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.373296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86f497f6883485c84c6ebfb1c2fc7cc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:01.389937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 976/1971] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:01 2022] DELETE /identity/v3/users/f86f497f6883485c84c6ebfb1c2fc7cc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:01.554478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:01.554999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:01.555106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:01.626829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] MFA Rules not processed for user `8e83d064ea6a45e79a28d261d2d24fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:01.632418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:01.789947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:01.867759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 996/1972] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:01.873374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:01.875155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:02.007661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26b7b-1207-4185-bd58-89fd3371ee64 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.023781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.025339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.025822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.026220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.028080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.031528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.100947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 977/1973] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:01 2022] POST /identity/v3/projects => generated 372 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:02.103432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.122181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2b9e-9017-4f92-a0d0-b95bd1b6f113 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.266400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.267056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.268422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.268714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.270833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.271560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.304555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 997/1974] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:02 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:02.308463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.320753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851493-6e5d-4647-98c8-1212c94e9e14 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.334395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.338306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.338789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.339168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.340317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.348876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.366585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 978/1975] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:02 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:02.371143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.384609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdce8c-06b8-4849-8d49-f5a20c870f50 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.400350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.402588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.402889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.403470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] PATH_INFO: `/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8/users/f3d996eb5eed46ec9acc8e9cbea4b048/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.464305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f86bbbe74240aca2d8d14acfc48ae8, user_id=f3d996eb5eed46ec9acc8e9cbea4b048, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.470676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.506772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 998/1976] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:02 2022] PUT /identity/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8/users/f3d996eb5eed46ec9acc8e9cbea4b048/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:02.507164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.508127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.509069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:02.533366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6ebd-985b-4cac-b99d-201232fd524f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.549644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:02.704506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.707510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.708058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.709651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] PATH_INFO: `/v3/projects/5d2c971e9ffa47e1bacbd4e3988a1f90` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.712917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2c971e9ffa47e1bacbd4e3988a1f90)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.737246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.744425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535a317-3cbb-4099-b338-c8e6b1dcc518 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.751802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.752455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.752740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.753644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.754415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.757099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.778661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 999/1977] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:02 2022] GET /identity/v3/roles => generated 1427 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:02.779634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.781996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:02.798499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813524-7fe3-4491-818f-bf2829d04411 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:02.804780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:02.805478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:02.806281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:02.806678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] PATH_INFO: `/v3/projects/e87012e43428447f862b3523945affb1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:02.808121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87012e43428447f862b3523945affb1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:02.812136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:02.858219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2c971e9ffa47e1bacbd4e3988a1f90', 'request_id': 'req-6ddbfde3-efe5-419a-983e-90b07f051d3a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.872691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2c971e9ffa47e1bacbd4e3988a1f90', 'request_id': 'req-6ddbfde3-efe5-419a-983e-90b07f051d3a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.888039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2c971e9ffa47e1bacbd4e3988a1f90', 'request_id': 'req-6ddbfde3-efe5-419a-983e-90b07f051d3a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.889567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:02.896811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87012e43428447f862b3523945affb1', 'request_id': 'req-6484ac1c-7904-49e2-af51-fa977a50f959'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.908803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87012e43428447f862b3523945affb1', 'request_id': 'req-6484ac1c-7904-49e2-af51-fa977a50f959'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.915461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] The token cache is being invalidate because project 5d2c971e9ffa47e1bacbd4e3988a1f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:02.916014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.918214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.922280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87012e43428447f862b3523945affb1', 'request_id': 'req-6484ac1c-7904-49e2-af51-fa977a50f959'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.925573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 979/1978] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:02 2022] DELETE /identity/v3/projects/5d2c971e9ffa47e1bacbd4e3988a1f90 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:02.926836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.933468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:02.940826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] The token cache is being invalidate because project e87012e43428447f862b3523945affb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:02.941620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.942738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:02.944864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1000/1979] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:02 2022] DELETE /identity/v3/projects/e87012e43428447f862b3523945affb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:02.947114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:02.951386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.032104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ac1c-7904-49e2-af51-fa977a50f959 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.038195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.039001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.039489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.039873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] PATH_INFO: `/v3/users/6d54116c4b7f46118373bfcad5921cd2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.041344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d54116c4b7f46118373bfcad5921cd2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.043971 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.066207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbfde3-efe5-419a-983e-90b07f051d3a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.072518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.072763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.072893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.073178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] PATH_INFO: `/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8/users/f3d996eb5eed46ec9acc8e9cbea4b048/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.075240 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f86bbbe74240aca2d8d14acfc48ae8, user_id=f3d996eb5eed46ec9acc8e9cbea4b048, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.078744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd10c4c-2158-4499-9346-2874ef443bc7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.098140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 980/1980] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:02 2022] PUT /identity/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8/users/f3d996eb5eed46ec9acc8e9cbea4b048/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:03.101331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dced9e-af76-4004-93a2-9cd44698a215 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.102005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dced9e-af76-4004-93a2-9cd44698a215 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.102005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dced9e-af76-4004-93a2-9cd44698a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.154394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-13dced9e-af76-4004-93a2-9cd44698a215 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:03.155720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-13dced9e-af76-4004-93a2-9cd44698a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.160601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d54116c4b7f46118373bfcad5921cd2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.162867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d54116c4b7f46118373bfcad5921cd2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.164118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d54116c4b7f46118373bfcad5921cd2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.179980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d54116c4b7f46118373bfcad5921cd2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.210209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d54116c4b7f46118373bfcad5921cd2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.232477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:03.274273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1001/1981] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:02 2022] DELETE /identity/v3/users/6d54116c4b7f46118373bfcad5921cd2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:03.274273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.275636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.302108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 981/1982] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:03.310232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.310541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.310805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.349207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:03.376772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:03.378023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.383638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283d862-6fb0-44dd-b038-83066c0ac559 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.400082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 982/1983] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:03.400996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.402203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.402639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.404433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.404800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] PATH_INFO: `/v3/users/d3e7b792dc7f4c44963d857ada3a06ff` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.407238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e7b792dc7f4c44963d857ada3a06ff)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.413203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.422132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e73cf-65cb-444c-863a-4415a8896485 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.438178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.438627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.438915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.439255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.440042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:03.440457 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.443953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.475904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 983/1984] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:45:03.480521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.507480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5da8f-9580-485f-bd30-1e25992c9a14 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.518293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e7b792dc7f4c44963d857ada3a06ff'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.519231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e7b792dc7f4c44963d857ada3a06ff'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.520179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.520914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.521264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.521563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.521674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e7b792dc7f4c44963d857ada3a06ff'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.522297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.524307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.543504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e7b792dc7f4c44963d857ada3a06ff'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.560855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f33e683-8510-4476-b09a-b6ca80095de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e7b792dc7f4c44963d857ada3a06ff'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:03.579659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 984/1985] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:03 2022] POST /identity/v3/projects => generated 384 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:03.584478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.591160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.607290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1002/1986] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:03 2022] DELETE /identity/v3/users/d3e7b792dc7f4c44963d857ada3a06ff => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:03.612645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.614161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.614740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.658437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:03.664796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.685609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc5bb7-da95-4d0f-b1af-a4e4627c2851 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.787274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.788468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.789207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.789679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.791487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.793783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.809268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1003/1987] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:03.829683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.833379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.839718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 985/1988] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:03 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:03.841708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.879279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca926-4c99-4d4b-9881-5280fb1e4f68 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.892717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.893672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.894128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.894644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.896237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.898233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.914201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 986/1989] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:03.916504 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:03.928176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:03.948857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfc20-a6d5-4b2c-8096-225b50fb2daf admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.955172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.956694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.957068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.957694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] PATH_INFO: `/v3/projects/247d868535a24e69b5a467b39529beb1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.959387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=247d868535a24e69b5a467b39529beb1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:03.961710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:03.978613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22177-3722-4750-96b5-d8f5bd22c6fa None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:03.983621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:03.984277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:03.984557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:03.984899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:03.995192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:04.005326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.009429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.041946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1004/1990] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:04.044282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.063726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14668f-2d8b-4554-b1fc-10f4006f8f49 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.066618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247d868535a24e69b5a467b39529beb1', 'request_id': 'req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:04.079596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:04.085997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247d868535a24e69b5a467b39529beb1', 'request_id': 'req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:04.104293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247d868535a24e69b5a467b39529beb1', 'request_id': 'req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:04.143601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] The token cache is being invalidate because project 247d868535a24e69b5a467b39529beb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:04.144026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:04.146429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d65d6afc-d199-40e5-a317-fe3f9a9a5cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:04.162026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 987/1991] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:03 2022] DELETE /identity/v3/projects/247d868535a24e69b5a467b39529beb1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:04.163926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.164393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.164684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.191536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.192333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.192780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.193075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.193779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.196049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e660d-e2d2-4590-a464-93e4adc78bd3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.204034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:04.206179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:04.219383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 988/1992] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:04.220982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1005/1993] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:04 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:04.228312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.228801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.229150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.231515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.234111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:04.253058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f5e8-64fc-4d90-a143-5fe5a52e9fd4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.259797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.260718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.261155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.261990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] PATH_INFO: `/v3/projects/24d789ad4b664458b4eab9489ad11308/users/345954e202a34b7a8c615329660c1a77/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.263010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:04.264836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:04.280393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1006/1994] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:04.287994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.290571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d789ad4b664458b4eab9489ad11308, user_id=345954e202a34b7a8c615329660c1a77, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.298815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d41f-4380-4a98-ade4-5ac34470c094 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.309291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb62eb-6990-40b8-85a6-a3db3178d9dc None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.321225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.322194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.322488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.322760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.323519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:04.323826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.325520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.335508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 989/1995] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:04 2022] PUT /identity/v3/projects/24d789ad4b664458b4eab9489ad11308/users/345954e202a34b7a8c615329660c1a77/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:04.353756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.353756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.353756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.358084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1007/1996] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:04.363406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.382222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c34a-0b61-49a4-9f02-67ba772512fd admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.435218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] MFA Rules not processed for user `345954e202a34b7a8c615329660c1a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:04.440195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:04.540111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.542860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.543283 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.544041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.546046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.549356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.612800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1008/1997] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/projects => generated 372 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:04.616549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.640813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 990/1998] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:04.642040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.677892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01261-5a3b-4440-ab75-0feeed05dc92 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.768476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b0e2-2be2-459f-a023-62245b96f994 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:04.785320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.786453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.786786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.787268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.788127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.793958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.812448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:04.813381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:04.814052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:04.814651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:04.815644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:04.818730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:04.827562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:04.870662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1009/1999] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:04.882937 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.889213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:04.911192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:04.917441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 991/2000] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:04 2022] POST /identity/v3/projects => generated 382 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:04.918442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:04.921208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2d163-683d-404a-b835-2a6c50ff7b71 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.127303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.128402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.128885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.129380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] PATH_INFO: `/v3/projects/754b38b8a306405c8057056abe262024` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.131778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754b38b8a306405c8057056abe262024)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.134675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.141969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6888e3-6e29-4830-bb6f-ffed5ecdc86c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.149930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.150792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.151246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.151633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.153071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.155514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.180273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 992/2001] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:04 2022] GET /identity/v3/roles => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:05.181385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.196753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88586-d950-4e1a-93b9-7db5cd2cc6d7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.212011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.212664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.212950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.213237 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.216066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.219061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.237476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754b38b8a306405c8057056abe262024', 'request_id': 'req-e69bb413-3c56-4b89-af61-b90b599de171'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.251868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754b38b8a306405c8057056abe262024', 'request_id': 'req-e69bb413-3c56-4b89-af61-b90b599de171'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.259957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754b38b8a306405c8057056abe262024', 'request_id': 'req-e69bb413-3c56-4b89-af61-b90b599de171'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.268147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 993/2002] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:05 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:05.269585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.281045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] The token cache is being invalidate because project 754b38b8a306405c8057056abe262024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:05.282048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.283156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.289118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1010/2003] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:04 2022] DELETE /identity/v3/projects/754b38b8a306405c8057056abe262024 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:05.290147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce203-794f-4c0a-b1d2-344a1a9a94e3 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.290843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.292608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:05.404755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bb413-3c56-4b89-af61-b90b599de171 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.409597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.409811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.409904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.413053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.413942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.417810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.417960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.418231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.418580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.419468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.420942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.421104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.433843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1011/2004] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:05 2022] GET /identity/v3/roles => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:05.434869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.436686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:05.466971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 994/2005] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:05 2022] GET /identity/v3/roles => generated 1427 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:05.467192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495583-6c28-4b2d-986c-88c46019abb5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.477926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.478754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.479654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.479938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] PATH_INFO: `/v3/users/1bca52cfc526413d8d54134dc5ca7a3c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.483146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bca52cfc526413d8d54134dc5ca7a3c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.484855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.485130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.514591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231553c-0a78-4f79-a0d0-68b590ac52eb admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.524667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.525627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.525927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.526216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] PATH_INFO: `/v3/projects/822ad8387ca74cc3abf5cb1707d241b6/users/2a48a0712a1d4c60b344e22a13d93728/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.551790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:05.565796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=822ad8387ca74cc3abf5cb1707d241b6, user_id=2a48a0712a1d4c60b344e22a13d93728, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.569550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.589189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bca52cfc526413d8d54134dc5ca7a3c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.591026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bca52cfc526413d8d54134dc5ca7a3c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.591850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bca52cfc526413d8d54134dc5ca7a3c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.596635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 995/2006] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:05 2022] PUT /identity/v3/projects/822ad8387ca74cc3abf5cb1707d241b6/users/2a48a0712a1d4c60b344e22a13d93728/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:05.597652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.600431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:05.612183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bca52cfc526413d8d54134dc5ca7a3c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.623091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bca52cfc526413d8d54134dc5ca7a3c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:05.662501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1012/2007] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:05 2022] DELETE /identity/v3/users/1bca52cfc526413d8d54134dc5ca7a3c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:05.663552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.665010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:05.686378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:05.733206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5fdbb-db55-46d3-850f-aeae8c37e27a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.774306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918083e-a564-43b9-b397-eaabf1425a0e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:05.783216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.784391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.784895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.785249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.786495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.789809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57cd0-ecaa-4766-b913-28f974c956ac admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.823836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:05.824860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.825153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.825511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] PATH_INFO: `/v3/projects/5527e5784b694436ae6e2e4ee18d945c/users/65cefaaa44894594a454b1f3d3fe23d3/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.841183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1013/2008] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:05 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:05.842921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb02-e009-4ad4-8fcc-8eb29f6ae434 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:05.843630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb02-e009-4ad4-8fcc-8eb29f6ae434 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:05.845091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb02-e009-4ad4-8fcc-8eb29f6ae434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:05.855391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5527e5784b694436ae6e2e4ee18d945c, user_id=65cefaaa44894594a454b1f3d3fe23d3, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:05.859087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:05.908032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 996/2009] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:05 2022] PUT /identity/v3/projects/5527e5784b694436ae6e2e4ee18d945c/users/65cefaaa44894594a454b1f3d3fe23d3/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:05.909210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:05.919739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7846fb02-e009-4ad4-8fcc-8eb29f6ae434 None None] MFA Rules not processed for user `f3d996eb5eed46ec9acc8e9cbea4b048`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:05.922704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7846fb02-e009-4ad4-8fcc-8eb29f6ae434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.113669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f645-869e-4534-a5e4-7e8010bb59dd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.122346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1014/2010] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:06.123814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.124097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.124372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.127332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.132421 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.132712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.133149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] PATH_INFO: `/v3/projects/822ad8387ca74cc3abf5cb1707d241b6/users/2a48a0712a1d4c60b344e22a13d93728/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.143015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822ad8387ca74cc3abf5cb1707d241b6, user_id=2a48a0712a1d4c60b344e22a13d93728, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.154006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.175871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 997/2011] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:05 2022] PUT /identity/v3/projects/822ad8387ca74cc3abf5cb1707d241b6/users/2a48a0712a1d4c60b344e22a13d93728/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:06.177005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.193693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.204502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] MFA Rules not processed for user `65cefaaa44894594a454b1f3d3fe23d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:06.209508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.223990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:06.287183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc47a8-cefe-4506-ba19-0badafbefb82 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.291462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.292760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.293051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.293332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.295563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.314030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:06.318775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1015/2012] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:06.318775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.318775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.393596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e4bc9-204b-4fb5-8a65-ad199bcfc034 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.398228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.399057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.399720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f2ab9-eb7c-4d47-b8d1-6f00cf9abf93 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.399835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.400092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.400369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] PATH_INFO: `/v3/projects/c453571bdfba4aed8428f60129bd2b78` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.401557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c453571bdfba4aed8428f60129bd2b78)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.403685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.409391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 998/2013] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:06.410713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d39ad-5a07-480d-8339-c795e03f94a1 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.411059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d39ad-5a07-480d-8339-c795e03f94a1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.411332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d39ad-5a07-480d-8339-c795e03f94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.447535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-277d39ad-5a07-480d-8339-c795e03f94a1 None None] MFA Rules not processed for user `2a48a0712a1d4c60b344e22a13d93728`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:06.449475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-277d39ad-5a07-480d-8339-c795e03f94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.469518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c453571bdfba4aed8428f60129bd2b78', 'request_id': 'req-13ad9bc5-e574-4c74-895f-9a249e876e88'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.478966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c453571bdfba4aed8428f60129bd2b78', 'request_id': 'req-13ad9bc5-e574-4c74-895f-9a249e876e88'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.486792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c453571bdfba4aed8428f60129bd2b78', 'request_id': 'req-13ad9bc5-e574-4c74-895f-9a249e876e88'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.503902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] The token cache is being invalidate because project c453571bdfba4aed8428f60129bd2b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:06.504205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.505161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.507325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1016/2014] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:06 2022] DELETE /identity/v3/projects/c453571bdfba4aed8428f60129bd2b78 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:06.507979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.509356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.556371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 999/2015] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:06.558019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daf58-92df-4c68-8aa6-294b90a7a1ae None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.558704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daf58-92df-4c68-8aa6-294b90a7a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.559073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daf58-92df-4c68-8aa6-294b90a7a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.572765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:06.579549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-509daf58-92df-4c68-8aa6-294b90a7a1ae None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:06.580983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-509daf58-92df-4c68-8aa6-294b90a7a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.590208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9bc5-e574-4c74-895f-9a249e876e88 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.596043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.597575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.597852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.598123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.604424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.663694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1000/2016] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:06.667267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.667596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.667889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.675436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.677950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.688936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1017/2017] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:06.692940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:06.694246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.706273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1001/2018] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:06.708843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.721931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.724444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.735297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694301b9-9e8f-45a4-9e68-f091871758c6 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.741478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.742443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.742967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.743527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.744018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a750a9-a5f2-413a-be0b-9c38987f44e8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.745124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:06.745662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.747890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.750212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.751176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.752494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.752693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] PATH_INFO: `/v3/users/65cefaaa44894594a454b1f3d3fe23d3` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.754610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cefaaa44894594a454b1f3d3fe23d3)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.756924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.767524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1018/2019] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:06.769085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.793913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5ad2b-f10e-416e-b1e7-6ce32a43874c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.799348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.800296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.801102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.801587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.814796 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:06.815190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.817967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.831209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1019/2020] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:06.832519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.841528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cefaaa44894594a454b1f3d3fe23d3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.848726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42878c79-8054-4222-9af7-23f51c215220 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:06.856756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:06.857632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.857742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cefaaa44894594a454b1f3d3fe23d3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.857927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.858202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.858912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cefaaa44894594a454b1f3d3fe23d3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.859089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:06.861454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:06.869061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cefaaa44894594a454b1f3d3fe23d3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.893930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-bd48cf9a-4156-47f2-b0b7-218f2a61f10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cefaaa44894594a454b1f3d3fe23d3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:06.901312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1020/2021] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/projects => generated 402 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:06.902847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1002/2022] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:06 2022] DELETE /identity/v3/users/65cefaaa44894594a454b1f3d3fe23d3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:06.907890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:06.908816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:06.909249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:06.909762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:06.910644 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.938791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:06.940031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:06.978152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506182a-8424-4e44-a4a5-88fe1ace000b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.002966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1003/2023] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:07.003828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.005175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.036042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:07.042181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.042851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.043147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.043525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.044430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.046835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.072704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d48b0-32d6-4fe1-9d1e-2a5487da2a45 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.074170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1021/2024] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:06 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:07.075100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.076768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.078787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.079582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.079852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.080129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.082067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.137656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcec0-74c7-4b30-bdbc-61e29efb430b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.141500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.142137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.142421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.142698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.149355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.150816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.155447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.156007 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:07.158008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.162210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1004/2025] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:07.164270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.169323 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1022/2026] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:07.184146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904875-69d6-48bd-8451-238a72b1af22 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.192668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.193436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.193593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.193861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.194627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.196330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.212058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1005/2027] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:07.213628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.225867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf411c-a9f3-43eb-8238-605e6da44b76 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.231585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.232295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.232583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.232847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.233621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.235391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcaffe-b1b4-4374-b97d-00aa59a1051c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.248279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1023/2028] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:07.251225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.263343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff741-1f55-4b53-b2a2-8439345a8ab8 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.270400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.270400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.270662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.271642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] PATH_INFO: `/v3/projects/0eebb11128214a0c83c5ab20d561496b/users/f2258b01a2ce430c8c9ece489ecc0221/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.293831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eebb11128214a0c83c5ab20d561496b, user_id=f2258b01a2ce430c8c9ece489ecc0221, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.297440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.315826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1006/2029] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:07 2022] PUT /identity/v3/projects/0eebb11128214a0c83c5ab20d561496b/users/f2258b01a2ce430c8c9ece489ecc0221/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:07.328509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.328843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.329545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.368181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] MFA Rules not processed for user `f2258b01a2ce430c8c9ece489ecc0221`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:07.368731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.456413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1024/2030] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:07.462402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.498424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.499978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.545187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62f7ed-46cb-4884-a7d0-26da3fb24b3c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.550369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.551009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.551294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.551669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.552676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.554476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.578839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbf6b5-1d75-4b3c-b623-4392948accf5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.583706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.584274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1007/2031] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/projects => generated 400 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:07.584387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.584614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.584885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] PATH_INFO: `/v3/projects/5527e5784b694436ae6e2e4ee18d945c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.585133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.586442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5527e5784b694436ae6e2e4ee18d945c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.586833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.588667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.600692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:07.639405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5527e5784b694436ae6e2e4ee18d945c', 'request_id': 'req-365b8aab-f084-4b6c-9100-b9f58ad48b6f'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.646072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5527e5784b694436ae6e2e4ee18d945c', 'request_id': 'req-365b8aab-f084-4b6c-9100-b9f58ad48b6f'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.651951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5527e5784b694436ae6e2e4ee18d945c', 'request_id': 'req-365b8aab-f084-4b6c-9100-b9f58ad48b6f'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.655031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c559-15ef-4790-8c46-9ee58d0d3e6f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.667870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] The token cache is being invalidate because project 5527e5784b694436ae6e2e4ee18d945c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:07.668155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.668772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.673969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1025/2032] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:07 2022] DELETE /identity/v3/projects/5527e5784b694436ae6e2e4ee18d945c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:07.673969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.673969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.710912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:07.718392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.719239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.719794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.720250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] PATH_INFO: `/v3/users/345954e202a34b7a8c615329660c1a77` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.721430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] RBAC: Authorizing `identity:delete_user(user_id=345954e202a34b7a8c615329660c1a77)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.723687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.737872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b8aab-f084-4b6c-9100-b9f58ad48b6f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.744118 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.744658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.744995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.745493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.746253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.748306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20c990-af6e-48db-aeba-4f2bb84d4ab1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.773354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1026/2033] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:07.773354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.773354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.773354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.778490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345954e202a34b7a8c615329660c1a77'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.786141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345954e202a34b7a8c615329660c1a77'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.787193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345954e202a34b7a8c615329660c1a77'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.794045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:07.795243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.797613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345954e202a34b7a8c615329660c1a77'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.805448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1027/2034] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:07.806284 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.816089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e962fd-9f94-4bf9-ab91-49ea7f80646d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.820797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a78257ad-2d44-4f63-b513-a183b37b86af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345954e202a34b7a8c615329660c1a77'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:07.821150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.821771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.822053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.822327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.823057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.824762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d128a4-7726-4858-ba7a-ac07ee2c1739 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.829670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1008/2035] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:07 2022] DELETE /identity/v3/users/345954e202a34b7a8c615329660c1a77 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:07.833520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.833520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.833520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.843859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1028/2036] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:07.843859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.843859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.843859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.859808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:07.861206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.871751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:07.873072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.926803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1009/2037] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:07.927921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.929303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.935569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1029/2038] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:07.938632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:07.940235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:07.941403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b82d-1918-4559-b2d3-b59de40b544a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:07.946577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:07.947242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:07.947566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:07.947850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] PATH_INFO: `/v3/projects/fe33379a187d4d90bb347d459160349a/users/9fc34da83db44c6796ec0fc1b20f071b/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:07.956328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:07.965427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe33379a187d4d90bb347d459160349a, user_id=9fc34da83db44c6796ec0fc1b20f071b, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:07.968715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:07.985561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1010/2039] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:07 2022] PUT /identity/v3/projects/fe33379a187d4d90bb347d459160349a/users/9fc34da83db44c6796ec0fc1b20f071b/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:07.986352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.012935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2eba1-34a7-48b3-b3d6-ad30ba44216f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.048203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:08.062542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9760-6812-4b70-b8c0-8a5f238a0546 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.069846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.070566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.070927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.071300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.072134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:08.072467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.072580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.073357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.073650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.073932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.074272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.076231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.087293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1011/2040] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:08.088122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.090015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.148526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.149996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.150776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648ddad-88e1-4787-a5b6-23e2d4bc89e2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.154487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.155479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.155479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.155748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.160604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1030/2041] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:08.161845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.167748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.169886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.172228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b589-2ff9-4bfb-a075-ba593cc2aaa1 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.177983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.178658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.179087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.179304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.179964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.181542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1012/2042] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:08.181666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.189278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.194249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1031/2043] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:08.198368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.202884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02d9c-c484-489b-b300-e7c314091519 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.210491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.211312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.211650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.211931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.212839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.213773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b846-91dc-45c7-8a88-e16d617074a9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.216158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208415-6d3d-4b3b-9c92-e00128a91577 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.221170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.221947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.222304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.222870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] PATH_INFO: `/v3/projects/fe33379a187d4d90bb347d459160349a/users/9fc34da83db44c6796ec0fc1b20f071b/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.226300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe33379a187d4d90bb347d459160349a, user_id=9fc34da83db44c6796ec0fc1b20f071b, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.229877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.250122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1032/2044] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:08 2022] PUT /identity/v3/projects/fe33379a187d4d90bb347d459160349a/users/9fc34da83db44c6796ec0fc1b20f071b/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:08.257456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1013/2045] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:08 2022] POST /identity/v3/projects => generated 392 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:08.261766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.262138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.262488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.262952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.302733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] MFA Rules not processed for user `9fc34da83db44c6796ec0fc1b20f071b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:08.304070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.337534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:08.353683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4597b-5ccc-4869-90b4-c05832c4854a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.435224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1014/2046] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:08.440633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.441586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.441871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.442214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.442969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.445192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.447778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.472655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1033/2047] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:08 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:08.473962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.485670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c24-4c15-4b84-bdeb-7a0e9891fd57 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.491058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.492049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.492215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.492489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.493259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.494972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.512136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1034/2048] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:08.515885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.528648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554f85-f9a6-4bd4-a029-91aaffb12ba3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.528856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7446-f5c2-43d7-b7df-aba35c7417d8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.533134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.533829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.534115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.534370 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.534489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.534996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.535489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.535939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.537016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.538856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.542902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:08.550261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.552423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1035/2049] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:08.553593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.556684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.558626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.567422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1015/2050] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:45:08.568472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.580253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bd0f-026c-4179-954c-279da95f61d5 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.586057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.586854 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.587291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.587735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] PATH_INFO: `/v3/projects/03d9ef61bb8a4135b72cf4ce535924ee/users/3d40e159a1314067ac986fc97920fb01/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.598132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520dff-6dcc-4998-8ef3-20fbb3deb7ac admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.603844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.605194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.605495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.605775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] PATH_INFO: `/v3/projects/24d789ad4b664458b4eab9489ad11308` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.607813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d789ad4b664458b4eab9489ad11308)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.611316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.621725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d9ef61bb8a4135b72cf4ce535924ee, user_id=3d40e159a1314067ac986fc97920fb01, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.624527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf06486-e735-40a9-98d9-4e4eb50d18d3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.641347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1016/2051] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:08 2022] PUT /identity/v3/projects/03d9ef61bb8a4135b72cf4ce535924ee/users/3d40e159a1314067ac986fc97920fb01/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:08.652955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.653263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.653554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.682845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d789ad4b664458b4eab9489ad11308', 'request_id': 'req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.684714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] MFA Rules not processed for user `3d40e159a1314067ac986fc97920fb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:08.685975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.693595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d789ad4b664458b4eab9489ad11308', 'request_id': 'req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.699948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d789ad4b664458b4eab9489ad11308', 'request_id': 'req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.713715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] The token cache is being invalidate because project 24d789ad4b664458b4eab9489ad11308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:08.714007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.714684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.716319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1036/2052] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:08 2022] DELETE /identity/v3/projects/24d789ad4b664458b4eab9489ad11308 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:08.717082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.718515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.759244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1017/2053] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:08.760447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.761792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.782369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba64b5-83cf-4d31-a0cf-5c2cf38244db admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.786165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.786790 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.787067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.787342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.789472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.794237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:08.828103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8656ce-c7c0-4a95-8929-832503727436 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.833021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.833675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.833967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.834247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] PATH_INFO: `/v3/users/2a48a0712a1d4c60b344e22a13d93728` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.835620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a48a0712a1d4c60b344e22a13d93728)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.837707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.852057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.853470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.863035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1037/2054] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:08.864147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:08.865953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:08.880090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b63fd-efc0-4c5b-8667-5bce604b45d3 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:08.884541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:08.885172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:08.885457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:08.885743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:08.890570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a48a0712a1d4c60b344e22a13d93728'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.896080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:08.898026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:08.900332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a48a0712a1d4c60b344e22a13d93728'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.901064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a48a0712a1d4c60b344e22a13d93728'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.909074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a48a0712a1d4c60b344e22a13d93728'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.909564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1038/2055] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:08.912500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:08.927242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d93b6a70-4505-4502-9f58-13b7fa57ce68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a48a0712a1d4c60b344e22a13d93728'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:08.942909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1018/2056] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:08 2022] DELETE /identity/v3/users/2a48a0712a1d4c60b344e22a13d93728 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:09.301694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.316613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa4087-4bcf-4f72-bf49-caf10a18c38b service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.399961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.400630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.400913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.401188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] PATH_INFO: `/v3/projects/822ad8387ca74cc3abf5cb1707d241b6` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.402368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=822ad8387ca74cc3abf5cb1707d241b6)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.404357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.473447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822ad8387ca74cc3abf5cb1707d241b6', 'request_id': 'req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:09.480967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822ad8387ca74cc3abf5cb1707d241b6', 'request_id': 'req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:09.486792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822ad8387ca74cc3abf5cb1707d241b6', 'request_id': 'req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:09.501851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] The token cache is being invalidate because project 822ad8387ca74cc3abf5cb1707d241b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:09.502336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:09.503039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2eca4b2a-8e56-43f9-a4ad-ec6bdac02d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:09.506046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1039/2057] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:09 2022] DELETE /identity/v3/projects/822ad8387ca74cc3abf5cb1707d241b6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:09.511219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.511751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.511851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.534035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:09.535439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:09.602268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1019/2058] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:09.610245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.610469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.610753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.632525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:09.633750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:09.644266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1040/2059] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:09.649335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.667729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3543dc-cd64-43de-b4f4-71bae1094db9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.672493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.673135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.673425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.673718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.674417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:09.674726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.676532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.703182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1020/2060] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:09.708527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.720622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be8ca-8424-46c5-993b-dfb6a7108ff2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.726522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.727268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.727772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.728128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.728897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.730925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.750033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:09.766019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1041/2061] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:09 2022] POST /identity/v3/projects => generated 384 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:09.770274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.782021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958edcc-6317-40a7-89ba-c44d5a5a6046 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.842647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.843345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.843663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.843938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.844625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.846556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.871209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1021/2062] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:09 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:09.875618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.886841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b186-e580-4fd9-a258-d78de16d7c4d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.891946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.892555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.892837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.893111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.894067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.896343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.908012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1042/2063] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:09 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:09.914484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.925649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784e87-d442-4289-9529-9f86144caad4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.931883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.932503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.932782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.933050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.933749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.935398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac300-c306-4bae-a9af-5e6309345631 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:09.947099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1022/2064] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:09 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:09.951820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:09.963325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e7dc-eda5-47a4-9be3-3cd546cfefd4 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:09.969870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:09.970556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:09.970830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:09.971083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] PATH_INFO: `/v3/projects/f3be0866ae4e428790486454aa2f75a6/users/2df51abae2974d02a82deb340a895d20/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:09.987015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3be0866ae4e428790486454aa2f75a6, user_id=2df51abae2974d02a82deb340a895d20, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:09.989962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.003969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1043/2065] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:09 2022] PUT /identity/v3/projects/f3be0866ae4e428790486454aa2f75a6/users/2df51abae2974d02a82deb340a895d20/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:10.016034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.016373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.016769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.045566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] MFA Rules not processed for user `2df51abae2974d02a82deb340a895d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:10.046787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:10.080304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:10.114936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1023/2066] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:10.122687 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.189199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ee30-230b-4965-88c6-4a9ba344a3fb admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.194948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.195598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.195878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.196154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.196853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.198782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.230885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1044/2067] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/projects => generated 380 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:10.235225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.251883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3164d0-5454-4d05-8ec4-647b317cd7de None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.314730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.315456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.315733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.316010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.316715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.318835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.343980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1024/2068] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:10.361777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.375852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a038-4558-40db-8956-b75ad191e9fd admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.380921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.381574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.381948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.383413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.384299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.385978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.398391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1045/2069] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:10.402330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.414516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70342-6eae-4ec5-84e7-15e6f2309812 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.419675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.420152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.420404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.420679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.421381 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.422987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e66b1-aa77-4eb5-bc3c-a2790704f3a7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.433926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1025/2070] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:10.438165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.449228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddcfd3-f893-4f50-b4ab-12c8c8542c81 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.454668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.455377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.455724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.455996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] PATH_INFO: `/v3/projects/4d8db2724950471fa15c0d2f18d39460/users/f9de6095e2de4b27a83d3e2e55433d55/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.472733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8db2724950471fa15c0d2f18d39460, user_id=f9de6095e2de4b27a83d3e2e55433d55, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.475630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.491932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1046/2071] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:10 2022] PUT /identity/v3/projects/4d8db2724950471fa15c0d2f18d39460/users/f9de6095e2de4b27a83d3e2e55433d55/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:10.503806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.504099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.504377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.539758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] MFA Rules not processed for user `f9de6095e2de4b27a83d3e2e55433d55`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:10.541727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:10.633272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1026/2072] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:10.638231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.712634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627488fc-8c27-4e6b-a7cb-fff52a416c13 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.717636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.718265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.718595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.718873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.719596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.721652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.737635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:10.753662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1047/2073] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/projects => generated 386 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:10.758451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.770339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588376b-5d41-4f2e-a5e6-508ace660754 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.815042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:10.832126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.832872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.833305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.833647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.834387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.836580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.859688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1027/2074] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:10 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:10.863787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.874391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48483-ca81-4c75-8f75-a854afb77c94 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.879573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.880650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.880936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.881240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.882180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.883870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.895211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1048/2075] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:10.899719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.910905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12df86d-efa2-4441-8b53-5da193a056e7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:10.917989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:10.918729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:10.919012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:10.929669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] PATH_INFO: `/v3/projects/3b1c5900593c461385937eadcbdf1163/users/57a933ad9c524242b10c6382d9770fc0/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:10.935042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1c5900593c461385937eadcbdf1163, user_id=57a933ad9c524242b10c6382d9770fc0, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:10.937839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:10.951963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1028/2076] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:10 2022] PUT /identity/v3/projects/3b1c5900593c461385937eadcbdf1163/users/57a933ad9c524242b10c6382d9770fc0/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:10.956026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:10.966553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd62f4-3ff1-4e17-9e52-bef07e8921c8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:11.027984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:11.028635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:11.028918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:11.029195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:11.029895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:11.031882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e583ce0-3a63-46fc-a373-129ab72fe434 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:11.049833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1049/2077] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:10 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:11.054326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:11.065029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4406-465e-42d2-ae24-ff0c36b0fe07 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:11.071391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:11.072546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:11.072911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:11.073279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] PATH_INFO: `/v3/projects/3b1c5900593c461385937eadcbdf1163/users/57a933ad9c524242b10c6382d9770fc0/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:11.076226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1c5900593c461385937eadcbdf1163, user_id=57a933ad9c524242b10c6382d9770fc0, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:11.080463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:11.096767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1029/2078] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:11 2022] PUT /identity/v3/projects/3b1c5900593c461385937eadcbdf1163/users/57a933ad9c524242b10c6382d9770fc0/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:11.107625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:11.107913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:11.108192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:11.137622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] MFA Rules not processed for user `57a933ad9c524242b10c6382d9770fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:11.138755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:11.219455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1050/2079] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:11.231533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:11.233436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:11.297726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0cf3a-f73c-4f80-9b79-f615ee58819b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:11.301566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:11.302267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:11.302543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:11.302815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:11.364369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:11.365842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:11.374890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1030/2080] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:15.046690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:15.059778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6fbef-aac0-4f75-9a12-96f022742ae2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:15.063990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:15.064609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:15.064888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:15.065163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:15.125863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:15.127324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44eaf5-e775-4513-862b-2d2c33d16e0e service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:15.138695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1051/2081] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:15.290193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:15.291491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:15.347120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:15.362062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad613c-0ac1-4038-b090-dbf53a1f031a service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:15.367522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:15.368191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:15.368633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:15.368919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] PATH_INFO: `/v3/users/f2258b01a2ce430c8c9ece489ecc0221` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:15.370118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2258b01a2ce430c8c9ece489ecc0221)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:15.372107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:15.425486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2258b01a2ce430c8c9ece489ecc0221'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:15.434757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2258b01a2ce430c8c9ece489ecc0221'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:15.435829 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2258b01a2ce430c8c9ece489ecc0221'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:15.445547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2258b01a2ce430c8c9ece489ecc0221'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:15.460881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2258b01a2ce430c8c9ece489ecc0221'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:15.466752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1031/2082] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:15 2022] DELETE /identity/v3/users/f2258b01a2ce430c8c9ece489ecc0221 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:15.471494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:15.471809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:15.472072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:15.479672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:15.495411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:15.496891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:15.564248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1052/2083] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:15 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:15.574725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:15.576111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:15.636283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95322405-73bb-4599-94e2-5f65504f4ab2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:15.640068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:15.640699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:15.640985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:15.641276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:15.650950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:15.652604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:15.663037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1032/2084] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:15 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:15.947385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:15.948981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:15.965287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad9eb-d844-4474-adb3-02c5d083b46c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:15.971415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:15.972411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:15.972683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:15.972975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] PATH_INFO: `/v3/projects/0eebb11128214a0c83c5ab20d561496b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:15.974838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eebb11128214a0c83c5ab20d561496b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:15.976825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.026575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eebb11128214a0c83c5ab20d561496b', 'request_id': 'req-3e34edde-0529-4030-ae7d-a39b1b144b70'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.033550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eebb11128214a0c83c5ab20d561496b', 'request_id': 'req-3e34edde-0529-4030-ae7d-a39b1b144b70'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.040057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eebb11128214a0c83c5ab20d561496b', 'request_id': 'req-3e34edde-0529-4030-ae7d-a39b1b144b70'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.054958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] The token cache is being invalidate because project 0eebb11128214a0c83c5ab20d561496b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:16.055583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.056000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.057606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1053/2085] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:15 2022] DELETE /identity/v3/projects/0eebb11128214a0c83c5ab20d561496b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:16.061740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.072305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100806-bbae-410e-a405-d3495c4f9632 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:16.131488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:16.132142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.132429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.132707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] PATH_INFO: `/v3/users/9fc34da83db44c6796ec0fc1b20f071b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.133982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc34da83db44c6796ec0fc1b20f071b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:16.136008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.150506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.188308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc34da83db44c6796ec0fc1b20f071b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.195652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc34da83db44c6796ec0fc1b20f071b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.196353 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc34da83db44c6796ec0fc1b20f071b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.204966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc34da83db44c6796ec0fc1b20f071b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.219286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc34da83db44c6796ec0fc1b20f071b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.226310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1033/2086] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:16 2022] DELETE /identity/v3/users/9fc34da83db44c6796ec0fc1b20f071b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:16.479863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.481419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:16.523493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.525531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:16.548809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34edde-0529-4030-ae7d-a39b1b144b70 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:16.590802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.595196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262674a-3bd1-46b9-94c1-4de4f8097f68 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:16.600525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:16.601178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.601487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.601603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:16.601761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] PATH_INFO: `/v3/projects/fe33379a187d4d90bb347d459160349a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.602215 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.602497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.602767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.602962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe33379a187d4d90bb347d459160349a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:16.604534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:16.604877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.654287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe33379a187d4d90bb347d459160349a', 'request_id': 'req-807b9ab5-097f-4b08-a05c-6c1b22524abd'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.663130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe33379a187d4d90bb347d459160349a', 'request_id': 'req-807b9ab5-097f-4b08-a05c-6c1b22524abd'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.668034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe33379a187d4d90bb347d459160349a', 'request_id': 'req-807b9ab5-097f-4b08-a05c-6c1b22524abd'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.669498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:16.670849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580e9e8-8219-46af-9b52-32b162e8ebf9 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.682317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1054/2087] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:45:16.686771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] The token cache is being invalidate because project fe33379a187d4d90bb347d459160349a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:16.687070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.687748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-807b9ab5-097f-4b08-a05c-6c1b22524abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:16.694210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1034/2088] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:16 2022] DELETE /identity/v3/projects/fe33379a187d4d90bb347d459160349a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:16.695998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.696396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.696557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.717502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:16.719594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:16.799800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1055/2089] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:16.807987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.808280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.808591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.831196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:16.832590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:16.841432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1035/2090] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:16.845648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.855957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5ef7-b526-4834-b2aa-c06841969adc None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:16.860756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:16.861385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.861668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.861945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.862657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:16.862967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:16.864652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.877169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1056/2091] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:16.882228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.893021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83811-d2eb-4259-913d-fdd6acf01b92 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:16.897940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:16.898577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:16.898865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:16.899259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:16.900043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:16.901951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:16.918985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.938574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1036/2092] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:16 2022] POST /identity/v3/projects => generated 384 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:16.939847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:16.952946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64cb67-6352-4d88-8b87-8faecdf03e4f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.026282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.027113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.027526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.027918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.028695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.030733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.062179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1057/2093] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:16 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:17.066265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.076749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d497-086e-4c41-8e10-dd889e3aad9c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.081360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.081980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.082258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.082531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.083630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.085279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.095718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1037/2094] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:17 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:17.099829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.110098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5770fc-238e-4b8b-836e-d207ae088e78 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.115342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.116028 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.116309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.116595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.117301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.118927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccff03-eca0-4c3e-88b9-05e36e4ccf33 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.121452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:17.131106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1058/2095] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:17 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:17.135818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.146102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda09-e537-4845-b3bc-00509f47b90e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.150818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.151518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.151805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.152086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] PATH_INFO: `/v3/projects/b71de4d2075141ac900ce86678352f1d/users/4451c9bd2f864df1afc088c339d7a1bc/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.167112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71de4d2075141ac900ce86678352f1d, user_id=4451c9bd2f864df1afc088c339d7a1bc, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.169840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.184912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1038/2096] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:17 2022] PUT /identity/v3/projects/b71de4d2075141ac900ce86678352f1d/users/4451c9bd2f864df1afc088c339d7a1bc/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:17.200842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.201177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.201474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.235589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] MFA Rules not processed for user `4451c9bd2f864df1afc088c339d7a1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:17.236863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:17.301278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1059/2097] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:17.317439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.319514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:17.380576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78118dd4-61b5-4106-b5a4-2e2c02f1f4f1 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.385830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.386702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.387082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.387431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.398117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.399631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7bf6-8bda-4213-a56d-c18eb71738d4 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.409034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1039/2098] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:17.428679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.505532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3d0de-ed5f-43af-9aa2-9389c370ff02 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.511510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.512153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.512436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.512712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] PATH_INFO: `/v3/users/4451c9bd2f864df1afc088c339d7a1bc` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.514014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4451c9bd2f864df1afc088c339d7a1bc)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.516050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.569031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4451c9bd2f864df1afc088c339d7a1bc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:17.569650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4451c9bd2f864df1afc088c339d7a1bc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:17.570265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4451c9bd2f864df1afc088c339d7a1bc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:17.578655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4451c9bd2f864df1afc088c339d7a1bc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:17.585910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4451c9bd2f864df1afc088c339d7a1bc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:17.603126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1060/2099] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:17 2022] DELETE /identity/v3/users/4451c9bd2f864df1afc088c339d7a1bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:17.607685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.608154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.608260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.632281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:17.633497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:17.707873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1040/2100] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:17.717869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:17.719616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:17.731179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:17.783522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2f3b-549a-4b78-8605-6f1946307fe5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:17.787850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:17.788474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:17.788755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:17.789038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:17.799409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:17.800920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76876092-88ce-4711-aa7c-566560148798 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:17.811698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1061/2101] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:17 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:18.092612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.094889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:18.118513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c25d1-392d-4bda-8cf3-227ad042b5db None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.123534 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.124195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.124605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.124742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] PATH_INFO: `/v3/projects/b71de4d2075141ac900ce86678352f1d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.125943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71de4d2075141ac900ce86678352f1d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.129681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.184321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71de4d2075141ac900ce86678352f1d', 'request_id': 'req-4e474abb-b3c3-4699-aac8-133c892e5f85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:18.190816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71de4d2075141ac900ce86678352f1d', 'request_id': 'req-4e474abb-b3c3-4699-aac8-133c892e5f85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:18.193419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:18.198223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71de4d2075141ac900ce86678352f1d', 'request_id': 'req-4e474abb-b3c3-4699-aac8-133c892e5f85'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:18.211992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] The token cache is being invalidate because project b71de4d2075141ac900ce86678352f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:18.212296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:18.212920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-4e474abb-b3c3-4699-aac8-133c892e5f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:18.214712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1041/2102] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:18 2022] DELETE /identity/v3/projects/b71de4d2075141ac900ce86678352f1d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:18.219522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.219987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.220076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.241356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:18.242571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:18.305465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1062/2103] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:18.314241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.314537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.314817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.335640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:18.336773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:18.345122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1042/2104] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:18.350133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.359914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3adc9-82d7-4a94-91dc-d814b5cb8f57 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.364761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.365385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.365664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.365941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.366645 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:18.366955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.368619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.381276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1063/2105] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:45:18.385707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.395165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9b93-18cc-4582-861b-15c1b2422766 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.400537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.401192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.401464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.401744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.402402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.404356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.433674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1043/2106] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:18 2022] POST /identity/v3/projects => generated 378 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:18.437903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.448788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0074-a52d-4d5b-922e-f78d3c80e14d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.506153 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.506803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.507089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.507391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.508059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.510005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.530627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1064/2107] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:18 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:18.535175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.546351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf549d9-d0f4-4161-ae7e-13f99be74dcc admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.552675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.553363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.553658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.553936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.554683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.556538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.568615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1044/2108] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:18.573040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.585045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428472-cfb0-4f8b-940d-c894c247414a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.591546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.592305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.592764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.593139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.594291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.597420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d792-24ea-4e48-9c8f-d059a9ae52a7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.610943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1065/2109] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:18 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:18.616197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.627190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea1900-136f-46db-8886-2b5ddaf3cac4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.632359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.633032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.633313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.633587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] PATH_INFO: `/v3/projects/46eb7ba4c1b44b7680ff3d8a05e981cc/users/1bd2b02b30ed41f49294dd1b65f11755/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.653046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46eb7ba4c1b44b7680ff3d8a05e981cc, user_id=1bd2b02b30ed41f49294dd1b65f11755, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.656602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.670331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1045/2110] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:18 2022] PUT /identity/v3/projects/46eb7ba4c1b44b7680ff3d8a05e981cc/users/1bd2b02b30ed41f49294dd1b65f11755/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:18.681077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.681369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.681647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.711329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] MFA Rules not processed for user `1bd2b02b30ed41f49294dd1b65f11755`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:18.713184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:18.719578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:18.790653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1066/2111] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:18.802177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:18.804264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:18.895973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd2cc-a383-4f02-ae1f-a723c6db48f2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:18.899919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:18.900590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:18.900906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:18.901188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:18.910830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:18.912503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165e09f-ca96-4418-a5ae-50e3dff4ca4a service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:18.921757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1046/2112] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:24.206548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:24.211935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:24.333434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf61b04-5bb6-47c9-98ac-7113d300b0e2 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:24.338512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:24.339209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:24.339530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:24.339874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] PATH_INFO: `/v3/users/2df51abae2974d02a82deb340a895d20` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:24.341099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df51abae2974d02a82deb340a895d20)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:24.343188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:24.392770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df51abae2974d02a82deb340a895d20'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:24.393469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df51abae2974d02a82deb340a895d20'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:24.394061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df51abae2974d02a82deb340a895d20'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:24.401938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df51abae2974d02a82deb340a895d20'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:24.411654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df51abae2974d02a82deb340a895d20'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:24.431377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1067/2113] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:24 2022] DELETE /identity/v3/users/2df51abae2974d02a82deb340a895d20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:24.436133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:24.436625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:24.436701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:24.461680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:24.462928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:24.527661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1047/2114] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:24.538746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:24.540388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:24.570325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:24.609194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8c25-5f16-4b56-8dc6-6c3eccda486b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:24.613252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:24.614137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:24.614491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:24.614934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:24.625944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:24.627539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:24.639150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1068/2115] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:24 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:24.986862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:24.988743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:24.998758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:25.003313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc593-bb4f-4b42-9cd4-7caa06a0a900 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:25.010331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:25.011396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:25.012515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:25.013374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] PATH_INFO: `/v3/projects/f3be0866ae4e428790486454aa2f75a6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:25.015282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3be0866ae4e428790486454aa2f75a6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:25.017363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:25.067543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3be0866ae4e428790486454aa2f75a6', 'request_id': 'req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.073987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3be0866ae4e428790486454aa2f75a6', 'request_id': 'req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.079998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3be0866ae4e428790486454aa2f75a6', 'request_id': 'req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.093933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] The token cache is being invalidate because project f3be0866ae4e428790486454aa2f75a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:25.094225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.094840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.096391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1048/2116] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:24 2022] DELETE /identity/v3/projects/f3be0866ae4e428790486454aa2f75a6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:25.100632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:25.111032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210d2e-a66c-4e8e-8640-0e2cba70344d service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:25.174127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:25.174804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:25.175070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:25.175346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] PATH_INFO: `/v3/users/f9de6095e2de4b27a83d3e2e55433d55` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:25.176632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9de6095e2de4b27a83d3e2e55433d55)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:25.178607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:25.225647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9de6095e2de4b27a83d3e2e55433d55'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.226417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9de6095e2de4b27a83d3e2e55433d55'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.227051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9de6095e2de4b27a83d3e2e55433d55'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.234491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9de6095e2de4b27a83d3e2e55433d55'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.241723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9de6095e2de4b27a83d3e2e55433d55'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.259562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1069/2117] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:25 2022] DELETE /identity/v3/users/f9de6095e2de4b27a83d3e2e55433d55 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:25.596143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:25.617861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:25.647865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a78b0-980a-4b2e-80cc-6428bfe0a5d7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:25.719911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:25.720488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:25.720768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:25.721044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] PATH_INFO: `/v3/projects/4d8db2724950471fa15c0d2f18d39460` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:25.722225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8db2724950471fa15c0d2f18d39460)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:25.724266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:25.774522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8db2724950471fa15c0d2f18d39460', 'request_id': 'req-015ed033-2168-4cc5-8c21-89dfc7f4286e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.782265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8db2724950471fa15c0d2f18d39460', 'request_id': 'req-015ed033-2168-4cc5-8c21-89dfc7f4286e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.788193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8db2724950471fa15c0d2f18d39460', 'request_id': 'req-015ed033-2168-4cc5-8c21-89dfc7f4286e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.803384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] The token cache is being invalidate because project 4d8db2724950471fa15c0d2f18d39460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:25.803681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.804313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.805968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1049/2118] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:25 2022] DELETE /identity/v3/projects/4d8db2724950471fa15c0d2f18d39460 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:25.810080 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:25.811622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:25.826038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1aa00-24af-4d1f-a6a8-51784dd2c105 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:25.880924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:25.904165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:25.905015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:25.905350 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:25.910217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] PATH_INFO: `/v3/users/57a933ad9c524242b10c6382d9770fc0` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:25.910217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a933ad9c524242b10c6382d9770fc0)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:25.910217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:25.984134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a933ad9c524242b10c6382d9770fc0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.984903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a933ad9c524242b10c6382d9770fc0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.985600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a933ad9c524242b10c6382d9770fc0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:25.996782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a933ad9c524242b10c6382d9770fc0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.006249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3f14284d-6704-4edb-9c54-b67c8cbea4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a933ad9c524242b10c6382d9770fc0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.026371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1070/2119] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:25 2022] DELETE /identity/v3/users/57a933ad9c524242b10c6382d9770fc0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:26.325759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.327403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:26.341731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed033-2168-4cc5-8c21-89dfc7f4286e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.362571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:26.412464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.413295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.413666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.414136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] PATH_INFO: `/v3/projects/3b1c5900593c461385937eadcbdf1163` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.415985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1c5900593c461385937eadcbdf1163)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.419024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.483842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1c5900593c461385937eadcbdf1163', 'request_id': 'req-c2771790-a257-4bd6-b8b1-18283261d4b8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.490536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1c5900593c461385937eadcbdf1163', 'request_id': 'req-c2771790-a257-4bd6-b8b1-18283261d4b8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.496379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1c5900593c461385937eadcbdf1163', 'request_id': 'req-c2771790-a257-4bd6-b8b1-18283261d4b8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.510461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] The token cache is being invalidate because project 3b1c5900593c461385937eadcbdf1163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:26.510759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.511495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c2771790-a257-4bd6-b8b1-18283261d4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:26.513110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1050/2120] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:26 2022] DELETE /identity/v3/projects/3b1c5900593c461385937eadcbdf1163 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:26.518348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.518802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.518942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.540155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:26.541355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:26.606382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1071/2121] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:26.614377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.614879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.614971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.636989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:26.638188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:26.647415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1051/2122] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:26.653926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.665183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181f58-5fba-4d33-9bd3-c87ab7380d7e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.671254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.671928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.672212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.672488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.673203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:26.673509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.675132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.688012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1072/2123] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:26.692310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.702016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c7b4-c4f1-4aac-b4ea-5abd7df400a7 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.707703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.708539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.708825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.709107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.709769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.711746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.745256 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1052/2124] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:26 2022] POST /identity/v3/projects => generated 384 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:26.750295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.770484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a337e9-9ba9-4a4e-847d-e692b177504c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.826325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:26.837720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.838548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.839030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.839313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.840033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.841978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.866504 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1073/2125] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:26 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:26.870783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.882448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d4547-350f-4de2-9b01-20040e9aef4e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.887218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.887884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.888167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.888471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.889180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.890789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.916303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1053/2126] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:26.921656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.934774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad477-bb6a-43d9-aba8-19a080ffab06 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.943016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.943692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.943978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.944255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:26.945002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:26.947030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc78683-1299-45aa-ac19-9b894df1a2be admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:26.960136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1074/2127] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:26 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:26.963903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:26.979216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe26f-09fa-4909-8722-56c9d384a39e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:26.984409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:26.985153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:26.985542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:26.985952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] PATH_INFO: `/v3/projects/ced140f6232545c38a8435ee60c38eca/users/9f6d1935c2d7456880a0dc529432361d/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:27.004315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced140f6232545c38a8435ee60c38eca, user_id=9f6d1935c2d7456880a0dc529432361d, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:27.007276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:27.034177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1054/2128] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:26 2022] PUT /identity/v3/projects/ced140f6232545c38a8435ee60c38eca/users/9f6d1935c2d7456880a0dc529432361d/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:27.044795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:27.045255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:27.045673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:27.087211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] MFA Rules not processed for user `9f6d1935c2d7456880a0dc529432361d`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:27.088516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:27.175393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1075/2129] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:27.189873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:27.192477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:27.280491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:27.295377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510de3-aa7a-4163-9aa5-4a2741fca09f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:27.300338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:27.308344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:27.308925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:27.309752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:27.322868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:27.325024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:27.344977 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1055/2130] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:28.278051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:28.280450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:28.414242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3e55-47be-4526-b594-7c6218b0ed58 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:28.420884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:28.421678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:28.422002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:28.422395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] PATH_INFO: `/v3/users/8e83d064ea6a45e79a28d261d2d24fa4` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:28.423740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e83d064ea6a45e79a28d261d2d24fa4)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:28.425808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:28.493522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e83d064ea6a45e79a28d261d2d24fa4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.494078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e83d064ea6a45e79a28d261d2d24fa4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.494672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e83d064ea6a45e79a28d261d2d24fa4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.504072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e83d064ea6a45e79a28d261d2d24fa4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.513430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e83d064ea6a45e79a28d261d2d24fa4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.514972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:28.537734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1076/2131] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:28 2022] DELETE /identity/v3/users/8e83d064ea6a45e79a28d261d2d24fa4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:28.725995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:28.755873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b42df-806d-4e98-a3f2-cc90ece3faf3 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:28.864338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:28.865304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:28.865585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:28.866517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] PATH_INFO: `/v3/projects/e64ea1b6bca64d68ab2dbf0e1ea17479` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:28.868528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64ea1b6bca64d68ab2dbf0e1ea17479)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:28.871665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:28.968495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64ea1b6bca64d68ab2dbf0e1ea17479', 'request_id': 'req-b5f24ba9-4499-4eff-8da2-6baf467e1a98'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.981254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64ea1b6bca64d68ab2dbf0e1ea17479', 'request_id': 'req-b5f24ba9-4499-4eff-8da2-6baf467e1a98'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:28.991641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64ea1b6bca64d68ab2dbf0e1ea17479', 'request_id': 'req-b5f24ba9-4499-4eff-8da2-6baf467e1a98'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.011642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] The token cache is being invalidate because project e64ea1b6bca64d68ab2dbf0e1ea17479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:29.012066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.012774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.014912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1056/2132] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:28 2022] DELETE /identity/v3/projects/e64ea1b6bca64d68ab2dbf0e1ea17479 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:29.019250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:29.021893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.050812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d7b0-502d-488b-9c8b-41d93d8e1406 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:29.134947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:29.135782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.136134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.136480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] PATH_INFO: `/v3/users/f3d996eb5eed46ec9acc8e9cbea4b048` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.137782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d996eb5eed46ec9acc8e9cbea4b048)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:29.140070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:29.203573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d996eb5eed46ec9acc8e9cbea4b048'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.204289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d996eb5eed46ec9acc8e9cbea4b048'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.204932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d996eb5eed46ec9acc8e9cbea4b048'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.218548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d996eb5eed46ec9acc8e9cbea4b048'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.228813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5003bace-8e59-4371-a57f-21b812042d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d996eb5eed46ec9acc8e9cbea4b048'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.262567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1077/2133] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:29 2022] DELETE /identity/v3/users/f3d996eb5eed46ec9acc8e9cbea4b048 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:29.347192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:29.349189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.363887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24ba9-4499-4eff-8da2-6baf467e1a98 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:29.445670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:29.446478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.446813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.447295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] PATH_INFO: `/v3/users/3d40e159a1314067ac986fc97920fb01` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.448891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d40e159a1314067ac986fc97920fb01)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:29.450322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:29.474001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:29.518819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d40e159a1314067ac986fc97920fb01'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.526884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d40e159a1314067ac986fc97920fb01'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.527726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d40e159a1314067ac986fc97920fb01'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.537276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d40e159a1314067ac986fc97920fb01'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.555402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d40e159a1314067ac986fc97920fb01'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.561703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1057/2134] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:29 2022] DELETE /identity/v3/users/3d40e159a1314067ac986fc97920fb01 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:29.566696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.567766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.567766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.593220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:29.594521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.607103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:29.609040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.673751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:29.689358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1078/2135] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:29.701252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a6dc-be7b-43d7-97ba-fa70512d077b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:29.706343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:29.706496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:29.707286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.707660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.708174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] PATH_INFO: `/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.708930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.709749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f86bbbe74240aca2d8d14acfc48ae8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:29.711840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:29.781702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f86bbbe74240aca2d8d14acfc48ae8', 'request_id': 'req-ba150f97-3fd7-40c9-a917-0be6233fb4d4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.815020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f86bbbe74240aca2d8d14acfc48ae8', 'request_id': 'req-ba150f97-3fd7-40c9-a917-0be6233fb4d4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.823236 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f86bbbe74240aca2d8d14acfc48ae8', 'request_id': 'req-ba150f97-3fd7-40c9-a917-0be6233fb4d4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.825681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec6e6-b2e2-4721-aac1-ecf50741c133 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:29.838812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] The token cache is being invalidate because project b1f86bbbe74240aca2d8d14acfc48ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:29.839106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.841033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ba150f97-3fd7-40c9-a917-0be6233fb4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:29.842989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1058/2136] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:29 2022] DELETE /identity/v3/projects/b1f86bbbe74240aca2d8d14acfc48ae8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:29.847662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1a29c-71bc-4e4c-9ad5-f9468c80ec91 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.847954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1a29c-71bc-4e4c-9ad5-f9468c80ec91 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.848275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1a29c-71bc-4e4c-9ad5-f9468c80ec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.877770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bfa1a29c-71bc-4e4c-9ad5-f9468c80ec91 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:29.877770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bfa1a29c-71bc-4e4c-9ad5-f9468c80ec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.892822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:29.893484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.893778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.894053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.896173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.909149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:29.963020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1059/2137] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:29.964665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:29.964958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:29.965247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:29.985791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:29.987025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:29.992303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:29.993854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:29.996454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1060/2138] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:30.000444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.005264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1079/2139] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:30.017311 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377014c-9c42-4ef6-8564-b4e2f7c65ff7 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.022856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.023546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.024129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.024129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.024818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:30.025121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.026959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.041689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1061/2140] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:30.048051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.067535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b406e-b415-4a24-8866-bbe128f43ff9 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.074852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.075871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.075999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.076196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.077199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.084029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.085315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.088501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.113469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441fa33-5cca-4b17-b8ac-24471c853d0d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.120097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.121179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.121825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.122326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] PATH_INFO: `/v3/users/9f6d1935c2d7456880a0dc529432361d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.124010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6d1935c2d7456880a0dc529432361d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.126574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.141996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1080/2141] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:30 2022] POST /identity/v3/projects => generated 372 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:30.146216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.202844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6d1935c2d7456880a0dc529432361d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.221153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6d1935c2d7456880a0dc529432361d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.221967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6d1935c2d7456880a0dc529432361d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.237585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6d1935c2d7456880a0dc529432361d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.255814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3f6a5370-fb69-4136-b975-d765d6010fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6d1935c2d7456880a0dc529432361d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.257158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:30.270227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1062/2142] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:30 2022] DELETE /identity/v3/users/9f6d1935c2d7456880a0dc529432361d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:30.274695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.274986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.275265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.290235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7995c9-6816-43f1-acaf-b0d7392ca256 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.302345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:30.304317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.379470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.380303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.380698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.381360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.382106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.384192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.386668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1063/2143] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:30.396697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.400093 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.439421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1081/2144] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:30 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:30.444675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.448443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.465730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72133-c682-47b2-8837-3b7e05670298 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.469897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:30.473783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.474717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.475067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.475442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.476533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.487634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.506847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1082/2145] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:30 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:30.510620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.522798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da085-954b-4499-9b1d-0e6d42445382 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.529744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79f71-3b3e-4d59-a52c-d6e06ec73915 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.530123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.532494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.533276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.533667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.534665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.537149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.542296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.543130 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.544659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.547112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.550659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1083/2146] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:30 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:30.555842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.568702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847a4b1-f2fb-4c0f-a178-9c590aa5bf7f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.579665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.579665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.579880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.579880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.579880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.579880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] PATH_INFO: `/v3/projects/e909b98552a841c988e49b79ba01fa64/users/053d69835219410f9a669f3afd120263/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.600669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1064/2147] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:30 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:30.615926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e909b98552a841c988e49b79ba01fa64, user_id=053d69835219410f9a669f3afd120263, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.619616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195562f-3149-4d84-8e3b-caedc8b0f364 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.652529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1084/2148] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:30 2022] PUT /identity/v3/projects/e909b98552a841c988e49b79ba01fa64/users/053d69835219410f9a669f3afd120263/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:30.657630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.658098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.658391 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.658827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.659330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.692542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:30.693921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.694364 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31166-5c09-4770-987a-2799761e4422 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:30.855466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1085/2149] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:30.885047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:30.885700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:30.885990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:30.886270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] PATH_INFO: `/v3/projects/03d9ef61bb8a4135b72cf4ce535924ee` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:30.887976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d9ef61bb8a4135b72cf4ce535924ee)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:30.889938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:30.922495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:30.924240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:30.974791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d9ef61bb8a4135b72cf4ce535924ee', 'request_id': 'req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.982720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d9ef61bb8a4135b72cf4ce535924ee', 'request_id': 'req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:30.994991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d9ef61bb8a4135b72cf4ce535924ee', 'request_id': 'req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.027794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:31.029622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] The token cache is being invalidate because project 03d9ef61bb8a4135b72cf4ce535924ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:31.030224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.037692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.040793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1065/2150] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:30 2022] DELETE /identity/v3/projects/03d9ef61bb8a4135b72cf4ce535924ee => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:31.056466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04836a77-d5b5-443d-92e7-0ccfe414934f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:31.167850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:31.168465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.168748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.169340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.173970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.205777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:31.207247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.310203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:31.311849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a69c-c61f-4877-b48e-b312fa03e065 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:31.322615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1086/2151] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:30 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:31.323392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:31.338076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7ee5-940b-4cc8-b29b-3bd4e9a49fce admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:31.343203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:31.343904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.344189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.344478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] PATH_INFO: `/v3/projects/ced140f6232545c38a8435ee60c38eca` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.345654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced140f6232545c38a8435ee60c38eca)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:31.347632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:31.427166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced140f6232545c38a8435ee60c38eca', 'request_id': 'req-477ef11e-a0d7-4a72-b534-b1db6b441f31'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.436401 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced140f6232545c38a8435ee60c38eca', 'request_id': 'req-477ef11e-a0d7-4a72-b534-b1db6b441f31'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.445155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced140f6232545c38a8435ee60c38eca', 'request_id': 'req-477ef11e-a0d7-4a72-b534-b1db6b441f31'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.458794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] The token cache is being invalidate because project ced140f6232545c38a8435ee60c38eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:31.458794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.459509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.461174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1066/2152] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:31 2022] DELETE /identity/v3/projects/ced140f6232545c38a8435ee60c38eca => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:31.468077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8cae-9541-4c94-b7bf-5ead4072b094 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.468891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8cae-9541-4c94-b7bf-5ead4072b094 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.469482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d8cae-9541-4c94-b7bf-5ead4072b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.500341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-255d8cae-9541-4c94-b7bf-5ead4072b094 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:31.501678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-255d8cae-9541-4c94-b7bf-5ead4072b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.564742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:31.566820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.588581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1087/2153] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:31.666633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef11e-a0d7-4a72-b534-b1db6b441f31 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:31.668739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.669034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.669377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.672972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:31.674105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.674105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.674340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] PATH_INFO: `/v3/users/4dc2f277a1d04094a77c6a0c90420f4a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.675609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc2f277a1d04094a77c6a0c90420f4a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:31.677841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:31.697938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:31.699512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.734328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1088/2154] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:31.738925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:31.753779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc45a-78fe-4f97-a2a3-1d09b5d5c7e5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:31.760502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:31.761579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.761867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.762164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.763067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:31.763388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:31.765100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:31.765945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc2f277a1d04094a77c6a0c90420f4a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.775322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc2f277a1d04094a77c6a0c90420f4a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.776325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc2f277a1d04094a77c6a0c90420f4a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.781918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1089/2155] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:31.787020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:31.789978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc2f277a1d04094a77c6a0c90420f4a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.803034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0d30-daf8-4d5b-b742-1e63a8d0a5ef admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:31.805764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc2f277a1d04094a77c6a0c90420f4a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:31.808965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:31.809759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:31.810135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:31.810416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:31.811126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:31.813017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1067/2156] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:31 2022] DELETE /identity/v3/users/4dc2f277a1d04094a77c6a0c90420f4a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:31.813201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:31.839467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:31.846991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1090/2157] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:31 2022] POST /identity/v3/projects => generated 386 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:31.852528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:31.854276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:31.862452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:31.947397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884b78a-67c6-4e45-9145-ad8318652876 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.050025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.050999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.051584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.051870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.052557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.054723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.080734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1068/2158] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:31 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:32.087161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.088005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.090228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.097617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429fb8-0518-4e4a-a163-2a77ffaebb98 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.106771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.107099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.107411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.107743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.108523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.110302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.112862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0d5b-cc1f-43c1-8a98-84461c3e0689 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.123281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.123439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1091/2159] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:32.124432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.124721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.125016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] PATH_INFO: `/v3/projects/46c32ca23c17400fb5388a652efacc54` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.126207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c32ca23c17400fb5388a652efacc54)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.127165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.128197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.137860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c16c0-904f-48f2-94c7-4050f2489c74 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.143058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.143789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.144135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.144469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.145317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.147081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.162042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1092/2160] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:32.163544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.175389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3d56a-2f2b-41ff-b8d6-b920eeedca36 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.187392 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c32ca23c17400fb5388a652efacc54', 'request_id': 'req-f07ea07d-68e6-4412-9500-2fe292e7be2a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:32.196592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c32ca23c17400fb5388a652efacc54', 'request_id': 'req-f07ea07d-68e6-4412-9500-2fe292e7be2a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:32.203270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c32ca23c17400fb5388a652efacc54', 'request_id': 'req-f07ea07d-68e6-4412-9500-2fe292e7be2a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:32.218568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] The token cache is being invalidate because project 46c32ca23c17400fb5388a652efacc54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:32.218963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:32.220061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f07ea07d-68e6-4412-9500-2fe292e7be2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:32.222042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1069/2161] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:32 2022] DELETE /identity/v3/projects/46c32ca23c17400fb5388a652efacc54 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:32.226903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501693-a8eb-49fa-9643-52a631623c52 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.227279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501693-a8eb-49fa-9643-52a631623c52 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.227814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501693-a8eb-49fa-9643-52a631623c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.248303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.249125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.249523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.249920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] PATH_INFO: `/v3/projects/958a479cb6904c1bb6e6868c2b061e02/users/30986eb76c6d4434b9c92f26d8418fbb/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.255511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-80501693-a8eb-49fa-9643-52a631623c52 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:32.256749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-80501693-a8eb-49fa-9643-52a631623c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.268938 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1070/2162] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:32.270749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958a479cb6904c1bb6e6868c2b061e02, user_id=30986eb76c6d4434b9c92f26d8418fbb, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.277464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb220-c782-439b-b7cb-6585254c12b7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.277595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.277595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.277776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.299342 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1093/2163] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:32 2022] PUT /identity/v3/projects/958a479cb6904c1bb6e6868c2b061e02/users/30986eb76c6d4434b9c92f26d8418fbb/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:32.308820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d5a3-3982-4a1b-a2b1-b31beaad2da1 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.309142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d5a3-3982-4a1b-a2b1-b31beaad2da1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.309386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78d5a3-3982-4a1b-a2b1-b31beaad2da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.330895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7c78d5a3-3982-4a1b-a2b1-b31beaad2da1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:32.332167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7c78d5a3-3982-4a1b-a2b1-b31beaad2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.338856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:32.340103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.350598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:32.408453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1094/2164] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:32.410079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.410372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.410679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.429176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1071/2165] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:32.430420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.433429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.449730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] MFA Rules not processed for user `053d69835219410f9a669f3afd120263`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:32.451053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.514340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfeeef6-8666-4bd3-a688-a9f21d133e8b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.514856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:32.518577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.519241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.519568 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.519865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.531321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.532933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.537768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1095/2166] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:32.542229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.547294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1072/2167] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:32.550374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.551990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:32.554835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4d364-0e98-4b5f-a20f-564b6c797b63 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.559498 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.560208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.560558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.560924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.561816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:32.562070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.563888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.577565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1096/2168] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:32.582587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.593228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166a4d-0526-48fc-b7bb-9f9150f9aa5c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.598741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.599437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.600136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.600136 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.600772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.602901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.619653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf172ab-a921-4176-bfe0-365528f8a7ec service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.626386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.627235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.627629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.628056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.641145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.643397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.647951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1097/2169] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/projects => generated 392 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:32.650085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.655088 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1073/2170] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:45:32.758444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885d95-56a2-4b6a-8d51-df5ec658b8b6 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.764719 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.765936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.766227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.766508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.767214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.769403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.797533 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1098/2171] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:32 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:32.802764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.815965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357414-bc91-43ab-8c28-441ba81fb60b service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.824363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.825616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.825907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.826869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.827055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.829689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.852126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1074/2172] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:32.854147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.869143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b26f1-095c-4f34-b64e-de114fd18dd9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.874220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.874928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.875278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.875667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.876452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.878137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ccded-5c42-44eb-9f64-25df4f83cb0d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:32.891964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1099/2173] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:32 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:32.896249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:32.930085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7dd2f-3359-4409-8466-6d32ae6850d0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:32.938822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:32.939596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:32.939885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:32.940162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] PATH_INFO: `/v3/projects/80b5e8457f2d47b7a7c0d2856a513b77/users/2a09fb7dd7ec47e5b37d533c3701a3a2/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:32.977634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b5e8457f2d47b7a7c0d2856a513b77, user_id=2a09fb7dd7ec47e5b37d533c3701a3a2, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:32.980374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:33.010098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1075/2174] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:32 2022] PUT /identity/v3/projects/80b5e8457f2d47b7a7c0d2856a513b77/users/2a09fb7dd7ec47e5b37d533c3701a3a2/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:33.015762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a0ae-2586-43a8-b206-000eac929534 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:33.015762 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a0ae-2586-43a8-b206-000eac929534 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:33.016299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a0ae-2586-43a8-b206-000eac929534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:33.052544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2f88a0ae-2586-43a8-b206-000eac929534 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:33.057051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2f88a0ae-2586-43a8-b206-000eac929534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:33.143882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1100/2175] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:33.154025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:33.186380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:33.213866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bd5d-77de-46be-b2c0-4c47485b955e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:33.217943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:33.218685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:33.218902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:33.219175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:33.230290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:33.232033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199db0c-ab32-438f-be3b-c8c2f99330fc service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:33.242766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1076/2176] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:33 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:34.201727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:34.202267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:34.202267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:34.232237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] MFA Rules not processed for user `053d69835219410f9a669f3afd120263`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:34.233676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:34.282022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:34.343657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1101/2177] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:40.629757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:40.630242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:40.630591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:40.662737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] MFA Rules not processed for user `30986eb76c6d4434b9c92f26d8418fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:40.664020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:40.795036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1077/2178] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:40.796411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:40.798162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:40.821224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3d9c7-a421-4b18-963c-c5e3f546f74d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:40.828665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:40.829674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:40.829961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:40.839859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:40.841975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:40.844170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:40.906117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1102/2179] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:40 2022] POST /identity/v3/projects => generated 384 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:40.908948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:40.924491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49078bbd-d808-4930-9e8b-263d5d9d4e05 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:41.014278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:41.014943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:41.015230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:41.015626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:41.016695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:41.018699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:41.058418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1078/2180] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:40 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:41.060531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:41.075958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe8bdf-cedd-4693-94f2-eb45cfbaea6f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:41.083172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:41.084477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:41.084820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:41.085293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:41.086592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:41.089590 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:41.107256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1103/2181] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:41 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:41.108495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:41.121706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8721-059a-48e5-a475-bc66338fb72b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:41.126520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:41.127222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:41.127542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:41.127818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] PATH_INFO: `/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a/users/9d81a3ced50645ebac427282eab51e47/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:41.148799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d43fb32d2a4e29936b9e5e9fb4be0a, user_id=9d81a3ced50645ebac427282eab51e47, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:41.152052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:41.172217 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1079/2182] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:41 2022] PUT /identity/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a/users/9d81a3ced50645ebac427282eab51e47/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:41.176281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:41.189074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6a0f-bc95-4ee2-a251-88d05d527655 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:41.280354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:41.280354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:41.280354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:41.280354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:41.281099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:41.281099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9be27-ec35-41aa-924c-7e10fd5db89b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:41.293497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1104/2183] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:41 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:41.299153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:41.313057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75433bc-90bd-42dd-bca6-7a5abeb0e0bd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:41.319994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:41.321057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:41.321819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:41.322491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] PATH_INFO: `/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a/users/9d81a3ced50645ebac427282eab51e47/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:41.325034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d43fb32d2a4e29936b9e5e9fb4be0a, user_id=9d81a3ced50645ebac427282eab51e47, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:41.328860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d221c1-3cce-4926-9952-d7ef7e77a164 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:41.350757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1080/2184] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:41 2022] PUT /identity/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a/users/9d81a3ced50645ebac427282eab51e47/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:42.359845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:42.360341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:42.360437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:42.407053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] MFA Rules not processed for user `2a09fb7dd7ec47e5b37d533c3701a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:42.408771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:42.580058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:42.580593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:42.580593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:42.585137 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1105/2185] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:42.607350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] MFA Rules not processed for user `2a09fb7dd7ec47e5b37d533c3701a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:42.609726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:42.635786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:42.636046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1081/2186] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:42.641941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:42.704946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:42.798424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dfcad-4f37-4ce1-b00a-2834657199c3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:42.814254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:42.814254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:42.814254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:42.814673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:42.832449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:42.835214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e5e3-3428-4b02-9356-e366dfee1a6c service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:42.847147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1106/2187] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:45:42.987922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:42.990753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:43.001012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:43.107507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aa5cc-aa2a-4098-869f-5ce1a7cba4d9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:43.112537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:43.113884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:43.114177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:43.115075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] PATH_INFO: `/v3/users/1bd2b02b30ed41f49294dd1b65f11755` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:43.116393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd2b02b30ed41f49294dd1b65f11755)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:43.118486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:43.198200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd2b02b30ed41f49294dd1b65f11755'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:43.207122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd2b02b30ed41f49294dd1b65f11755'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:43.209188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd2b02b30ed41f49294dd1b65f11755'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:43.223094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd2b02b30ed41f49294dd1b65f11755'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:43.245071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd2b02b30ed41f49294dd1b65f11755'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:43.257595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1082/2188] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:42 2022] DELETE /identity/v3/users/1bd2b02b30ed41f49294dd1b65f11755 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:43.257856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:43.258294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:43.258772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:43.284384 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:43.286420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:43.408013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:43.413347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:43.431589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1107/2189] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:43 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:43.580704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170ece-4bf4-4372-9320-6fc21fb062d5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:43.585472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:43.586374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:43.586747 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:43.587181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:43.603443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:43.605678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284fcf3-f11f-4fbc-b9ad-49ab78da5e55 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:43.619051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1083/2190] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:44.140162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:44.141856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:44.163142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f78f8-ec13-4907-b9ce-1982219330ce None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:44.182150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:44.182855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.183149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.183453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] PATH_INFO: `/v3/projects/46eb7ba4c1b44b7680ff3d8a05e981cc` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.187561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46eb7ba4c1b44b7680ff3d8a05e981cc)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:44.189618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:44.290392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46eb7ba4c1b44b7680ff3d8a05e981cc', 'request_id': 'req-abf8839e-2a46-4230-b87b-2ab8cb61b653'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:44.298758 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46eb7ba4c1b44b7680ff3d8a05e981cc', 'request_id': 'req-abf8839e-2a46-4230-b87b-2ab8cb61b653'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:44.306684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46eb7ba4c1b44b7680ff3d8a05e981cc', 'request_id': 'req-abf8839e-2a46-4230-b87b-2ab8cb61b653'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:44.322275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] The token cache is being invalidate because project 46eb7ba4c1b44b7680ff3d8a05e981cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:44.322579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:44.323273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-abf8839e-2a46-4230-b87b-2ab8cb61b653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:44.328379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1108/2191] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:44 2022] DELETE /identity/v3/projects/46eb7ba4c1b44b7680ff3d8a05e981cc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:44.330136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.330432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.330701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.385983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:44.390506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:44.461290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:44.568899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.569608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.569608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.571231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1084/2192] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:44.627501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:44.633677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:44.660708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1109/2193] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:44.662324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:44.677244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db6362-99f3-4d7e-83ea-d901c8322f5b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:44.683216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:44.684251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.686378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.686861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.688198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:44.690777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:44.707758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:44.755299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1085/2194] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:44.755910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:44.772468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2f5e-4744-4604-b34b-076cf67ba19f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:44.781458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:44.782406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.782925 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.783449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.784398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:44.790499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:44.867436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1110/2195] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:44 2022] POST /identity/v3/projects => generated 362 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:44.870412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:44.885523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00ab1f-f4b7-4b15-8b99-a57e15794aa4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:44.986497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:44.986986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:44.987279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:44.987593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:44.988619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:44.990746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:45.035607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1086/2196] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:44 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:45.037020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:45.051098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be289ca-7c97-402d-be8d-2b51a23b84b6 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:45.064547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:45.065213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.065501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.069804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.070591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:45.072298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:45.118293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1111/2197] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:45 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:45:45.122564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:45.141184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef137f07-84c2-4a9c-a61d-48c1f2c02499 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:45.155516 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:45.156988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.156988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.157196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.157978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:45.163031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65a37-acab-4a4b-b799-aaabae0e1f22 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:45.195162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1087/2198] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:45 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:45.196789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:45.208721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:45.265632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389869f-d975-469f-bdce-6c891355892c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:45.274469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:45.275157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.284880 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.285102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] PATH_INFO: `/v3/projects/a364543e288441be999bef6aeb7e8265/users/0915cebb5f604946bb02ea94eda1fb4d/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.327732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a364543e288441be999bef6aeb7e8265, user_id=0915cebb5f604946bb02ea94eda1fb4d, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:45.353997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7175-6f30-4142-9aee-7fbdf8dcca99 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:45.408801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1112/2199] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:45 2022] PUT /identity/v3/projects/a364543e288441be999bef6aeb7e8265/users/0915cebb5f604946bb02ea94eda1fb4d/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:45.410647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953359db-1c07-4387-b074-a13d93e20245 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.410997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953359db-1c07-4387-b074-a13d93e20245 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.411447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953359db-1c07-4387-b074-a13d93e20245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.464591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.465228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.465736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.499106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-953359db-1c07-4387-b074-a13d93e20245 None None] MFA Rules not processed for user `0915cebb5f604946bb02ea94eda1fb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:45.500383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-953359db-1c07-4387-b074-a13d93e20245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:45.501924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] MFA Rules not processed for user `2a09fb7dd7ec47e5b37d533c3701a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:45.505077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:45.677890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1088/2200] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:45.720573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1113/2201] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:45:45.744595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953359db-1c07-4387-b074-a13d93e20245 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:45.746803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-953359db-1c07-4387-b074-a13d93e20245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:45.801248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:45.859479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953359db-1c07-4387-b074-a13d93e20245 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:45.873873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:45.877474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:45.879591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:45.879885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:45.937598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:45.940000 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c125-309c-410f-8ca9-401c950a5719 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:45.987780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1089/2202] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:45:46.002698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:46.225393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb770b-cd72-4cae-995b-94540f3aec67 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:46.239939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:46.240627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:46.246291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:46.246605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] PATH_INFO: `/v3/users/0915cebb5f604946bb02ea94eda1fb4d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:46.248400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0915cebb5f604946bb02ea94eda1fb4d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:46.250767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:46.351017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0915cebb5f604946bb02ea94eda1fb4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:46.351861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0915cebb5f604946bb02ea94eda1fb4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:46.352555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0915cebb5f604946bb02ea94eda1fb4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:46.363312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0915cebb5f604946bb02ea94eda1fb4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:46.375946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0915cebb5f604946bb02ea94eda1fb4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:46.399680 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1114/2203] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:45:46 2022] DELETE /identity/v3/users/0915cebb5f604946bb02ea94eda1fb4d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:46.404656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:46.405205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:46.406129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:46.455440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:46.459393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:46.599551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1090/2204] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:46.617485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:46.619024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:46.625158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:46.739814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6e5f-1ef8-4eda-82e0-d7a466615614 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:46.747702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:46.748929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:46.749561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:46.750124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:46.772095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:46.774019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6700d6-a671-49b0-8def-098b0b8c3914 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:46.798496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1115/2205] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:47.324393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:47.328129 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:47.384915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62574d0f-a34e-4975-9798-7d59f78f4d3a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:47.403814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:47.404781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:47.405235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:47.406305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] PATH_INFO: `/v3/projects/a364543e288441be999bef6aeb7e8265` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:47.408172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a364543e288441be999bef6aeb7e8265)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:47.410464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:47.537395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a364543e288441be999bef6aeb7e8265', 'request_id': 'req-597b95ab-00e7-4ab8-ab83-17af5c4921f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:47.563052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a364543e288441be999bef6aeb7e8265', 'request_id': 'req-597b95ab-00e7-4ab8-ab83-17af5c4921f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:47.586543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a364543e288441be999bef6aeb7e8265', 'request_id': 'req-597b95ab-00e7-4ab8-ab83-17af5c4921f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:47.621792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] The token cache is being invalidate because project a364543e288441be999bef6aeb7e8265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:45:47.622441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:47.626262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-597b95ab-00e7-4ab8-ab83-17af5c4921f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:45:47.638916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:47.639322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:47.639712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:47.644193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1091/2206] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:45:47 2022] DELETE /identity/v3/projects/a364543e288441be999bef6aeb7e8265 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:45:47.685321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:47.688077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:47.897291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1116/2207] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:47.904922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:47.905190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:47.905495 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:47.943588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:47.944819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:47.979923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:47.980190 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1092/2208] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:47.995871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fba64-a49b-4aac-90b5-29dc4be6bf79 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.007891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.009368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.011251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.011702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.012526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:45:48.012843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.032146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.088715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1117/2209] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:45:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:45:48.093803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.109544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f012f-b8d7-42fa-8874-dec59f1f609d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.171152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.173667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.174063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.176099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.177704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.182872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.283213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.285057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1093/2210] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:45:48 2022] POST /identity/v3/projects => generated 372 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:45:48.316664 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186482-0d5a-451f-a561-0b41b5d7b171 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.441331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.442642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.443060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.443343 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.444072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.447262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.487606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1118/2211] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:45:48 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:45:48.490467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.508322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e045-d5cc-4100-9cbe-ee8abe9b6300 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.514640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.515710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.516212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.516862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.517933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.521222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.544906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.545104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1094/2212] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:48 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:48.559101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6811-e1bf-4946-819c-66fdced66205 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.567390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.569994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.570960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.571440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.572757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.574779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ff017-a6fc-44af-ba6b-4b85fe2c6bce admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.610963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.615422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1119/2213] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:45:48 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:45:48.630836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a882-650c-4c45-83e4-c47181bf4bba admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:48.637548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:48.638525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.639089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.639556 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] PATH_INFO: `/v3/projects/14277b321e0043f9a0846cc4949465c7/users/9808a95e377143e2a77547c14e7932a4/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.644969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:48.677422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14277b321e0043f9a0846cc4949465c7, user_id=9808a95e377143e2a77547c14e7932a4, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:48.682647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:48.706075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1095/2214] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:45:48 2022] PUT /identity/v3/projects/14277b321e0043f9a0846cc4949465c7/users/9808a95e377143e2a77547c14e7932a4/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:45:48.708100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecd9-08d7-47c4-990f-ad9b3a5a6eb0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:48.708425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecd9-08d7-47c4-990f-ad9b3a5a6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:48.708776 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ecd9-08d7-47c4-990f-ad9b3a5a6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:48.753176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4ae4ecd9-08d7-47c4-990f-ad9b3a5a6eb0 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:48.754561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4ae4ecd9-08d7-47c4-990f-ad9b3a5a6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:48.773339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:48.902140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1120/2215] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:48.969284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:48.971043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:49.057001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0607aa-a1a2-4e11-819d-375f8d2b8306 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:49.065476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:49.066567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:49.067040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:49.067485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:49.079204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:49.081259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:49.100616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1096/2216] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:51.619253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a551-5ef6-40a0-b3ca-3e22440c7410 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:51.619729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a551-5ef6-40a0-b3ca-3e22440c7410 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:51.619820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a551-5ef6-40a0-b3ca-3e22440c7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:51.658567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-dd85a551-5ef6-40a0-b3ca-3e22440c7410 None None] MFA Rules not processed for user `9d81a3ced50645ebac427282eab51e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:51.661171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dd85a551-5ef6-40a0-b3ca-3e22440c7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:51.823860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1121/2217] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:51.833017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:51.834587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:51.917521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165020-7629-45bd-9404-f2b8c5fd11a1 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:51.928561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:51.929978 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:51.930769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:51.931244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:51.934280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:52.080764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:52.083009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:52.097587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1097/2218] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:45:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:45:52.401895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a8e3-b4ed-4cce-a09a-4e16cd67dd86 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:52.402185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a8e3-b4ed-4cce-a09a-4e16cd67dd86 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:52.402466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a8e3-b4ed-4cce-a09a-4e16cd67dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:52.426775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fe38a8e3-b4ed-4cce-a09a-4e16cd67dd86 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:45:52.427026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fe38a8e3-b4ed-4cce-a09a-4e16cd67dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:52.543269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1122/2219] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:45:52.599207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:45:52.601669 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:45:52.748542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:52.791849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7086e3-223e-4369-956a-20f029d5129a service glance] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:45:52.797805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:45:52.798509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:45:52.798791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:45:52.799072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:45:52.811480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:45:52.813229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844635-fe9c-41ad-9fb4-4ec9ba481301 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:45:52.837510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1098/2220] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:45:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:46:00.032066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e96dd-3c5e-4404-8d04-f7dd73196a57 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:00.032671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e96dd-3c5e-4404-8d04-f7dd73196a57 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:00.032671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e96dd-3c5e-4404-8d04-f7dd73196a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:00.080022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f09e96dd-3c5e-4404-8d04-f7dd73196a57 None None] MFA Rules not processed for user `053d69835219410f9a669f3afd120263`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:00.080022 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f09e96dd-3c5e-4404-8d04-f7dd73196a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:00.245288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:00.324653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1123/2221] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:00.749616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:00.750259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:00.750259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:00.790845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] MFA Rules not processed for user `9808a95e377143e2a77547c14e7932a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:00.795115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:00.826465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:00.827017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:00.833681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:00.900734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] MFA Rules not processed for user `8e1baad75342476aa0c64bda0414e334`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:00.903652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:00.945299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1099/2222] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:00.947648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:00.986427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195ab1c-c9d9-4b48-94da-7a5dbc3a7071 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:00.992181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:00.993199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:00.994139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:00.994139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:00.995080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:00.999790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.102169 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1100/2223] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:46:00 2022] POST /identity/v3/projects => generated 372 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:46:01.104273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:01.113655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1124/2224] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:46:01.322971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47985d-d9cb-42ee-a4cd-c30430d742af admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:01.328551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:01.329440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:01.329789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:01.330225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:01.331041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:01.333194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.384743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:01.386339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1101/2225] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:46:01 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:46:01.412657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0c8f-724b-482c-a98d-a451079c2094 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:01.425029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:01.425843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:01.426337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:01.426628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:01.427500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:01.432953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.467483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1125/2226] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:46:01 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:46:01.468662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:01.483587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937008f-9360-4a86-819d-b3022225bc5d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:01.491258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:01.492105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:01.492567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:01.492915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] PATH_INFO: `/v3/projects/a877a8c68bfb480c814f6b22633932d2/users/146f002d8092498cbc01710aefeb0e79/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:01.520571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a877a8c68bfb480c814f6b22633932d2, user_id=146f002d8092498cbc01710aefeb0e79, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:01.523560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.549540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1102/2227] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:46:01 2022] PUT /identity/v3/projects/a877a8c68bfb480c814f6b22633932d2/users/146f002d8092498cbc01710aefeb0e79/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:46:01.554165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:01.571941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2ba7-d532-4ba1-9629-9532eaf928fc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:01.681698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:01.682588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:01.682944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:01.683286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:01.684103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:01.685821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92388e1-24fd-49c6-b3eb-bade16231c1b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.698672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1126/2228] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:46:01 2022] GET /identity/v3/roles => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:46:01.702574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:01.710802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:01.716383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57bf8-3110-4db7-8e18-1c7ac1e611f6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:01.741024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:01.741761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:01.742042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:01.763737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] PATH_INFO: `/v3/projects/a877a8c68bfb480c814f6b22633932d2/users/146f002d8092498cbc01710aefeb0e79/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:01.774293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a877a8c68bfb480c814f6b22633932d2, user_id=146f002d8092498cbc01710aefeb0e79, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:01.784559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:01.809910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1103/2229] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:46:01 2022] PUT /identity/v3/projects/a877a8c68bfb480c814f6b22633932d2/users/146f002d8092498cbc01710aefeb0e79/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:46:10.889801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d5187-1bbd-4edc-bc2f-8ef54acfbd48 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:10.890876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d5187-1bbd-4edc-bc2f-8ef54acfbd48 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:10.891723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d5187-1bbd-4edc-bc2f-8ef54acfbd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:10.951394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-779d5187-1bbd-4edc-bc2f-8ef54acfbd48 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:10.954419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-779d5187-1bbd-4edc-bc2f-8ef54acfbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:11.134112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1127/2230] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:46:10 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:11.138535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:11.231404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ae6f-f2bc-4408-9e08-e3ee4bfdcc15 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:11.244386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:11.245319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:11.245752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:11.246453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:11.259064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:11.260961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d0d9-9fbf-42b1-9b34-89b2ad3baff5 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:11.273602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1104/2231] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:46:15.592657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:15.593787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:15.594216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:15.645826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] MFA Rules not processed for user `30986eb76c6d4434b9c92f26d8418fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:15.647462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:15.677924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:15.734325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1128/2232] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:17.271538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750465-696c-4dbe-9be1-01c402a120b1 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:17.272615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750465-696c-4dbe-9be1-01c402a120b1 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:17.273081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0750465-696c-4dbe-9be1-01c402a120b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:17.326489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f0750465-696c-4dbe-9be1-01c402a120b1 None None] MFA Rules not processed for user `146f002d8092498cbc01710aefeb0e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:17.328811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f0750465-696c-4dbe-9be1-01c402a120b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:17.478134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1105/2233] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:18.165258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:18.166814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:18.340610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707754-b944-4d03-bf8d-69e32a0a4d97 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:18.357071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:18.357913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:18.358427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:18.358981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:18.481668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:18.483894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96e34-bd86-46d6-b9f7-ad0913253df0 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:18.532611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1129/2234] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:46:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:46:21.023700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778cbf-24f5-4fe4-b033-d945d7616787 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:21.024196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778cbf-24f5-4fe4-b033-d945d7616787 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:21.024275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778cbf-24f5-4fe4-b033-d945d7616787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:21.033799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:21.035416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:21.036004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:21.068921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:21.070787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:21.070933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-12778cbf-24f5-4fe4-b033-d945d7616787 None None] MFA Rules not processed for user `9808a95e377143e2a77547c14e7932a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:21.078570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-12778cbf-24f5-4fe4-b033-d945d7616787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:21.081316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1130/2235] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:46:21 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:46:21.093242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1106/2236] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:46:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:21.113915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:21.133791 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6340d-6a12-4c2f-88d1-47609cae472f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:21.147272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:21.148558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:21.148891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:21.149170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:21.176115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:21.179931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e795a-c281-4073-8ec7-b88db9924ad8 service swift] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:21.214174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1131/2237] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 20:46:31.054544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:31.206282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=80 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:42.484922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.485471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.486952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1107/2238] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:46:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:46:42.493648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde28fe-76c9-41b2-8a00-80c0e473dbcc None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.494157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde28fe-76c9-41b2-8a00-80c0e473dbcc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.494268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde28fe-76c9-41b2-8a00-80c0e473dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.518007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4cde28fe-76c9-41b2-8a00-80c0e473dbcc None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:42.519417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4cde28fe-76c9-41b2-8a00-80c0e473dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:42.530976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1132/2239] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:42.543435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:42.545362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:42.608058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064947-fa0f-4ee8-b3b9-ecf199895e7a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:42.612292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:42.612949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.613235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.613511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.624225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:42.625660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b032d54-9862-4794-b401-12eb9f4cd6d5 service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:42.636814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1108/2240] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:46:42.713649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550161-ee0e-474a-93de-f053813f6dda None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.714169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550161-ee0e-474a-93de-f053813f6dda None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.715242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c550161-ee0e-474a-93de-f053813f6dda None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.716907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1133/2241] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:46:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:46:42.724165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30532e-830b-47b1-af2d-1e1a408464ce None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.724679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30532e-830b-47b1-af2d-1e1a408464ce None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.725054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30532e-830b-47b1-af2d-1e1a408464ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.748064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-af30532e-830b-47b1-af2d-1e1a408464ce None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:42.749299 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-af30532e-830b-47b1-af2d-1e1a408464ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:42.808648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1109/2242] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:42.820610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c550161-ee0e-474a-93de-f053813f6dda None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:42.832737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c550161-ee0e-474a-93de-f053813f6dda None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:42.836647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:42.837338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.837618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.837887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.845628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:42.847257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff76144-585d-4f09-9f75-f760bb04dd1b service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:42.856277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1134/2243] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:46:42.943122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.943462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.943742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.945157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1110/2244] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:46:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:46:42.951329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e1e4-436e-4901-a478-f656deb5a3c7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:42.951659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e1e4-436e-4901-a478-f656deb5a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:42.951932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e1e4-436e-4901-a478-f656deb5a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:42.980929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2720e1e4-436e-4901-a478-f656deb5a3c7 None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:42.982145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2720e1e4-436e-4901-a478-f656deb5a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:42.994415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1135/2245] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:46:43.017455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:43.020312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:43.034439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039cb81-86a9-4ebf-8a49-d410fb3146f4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:43.038468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:43.039107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:43.039423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:43.039708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:43.050892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:43.052394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:43.063651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1111/2246] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:46:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:46:46.490737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc380e3-9338-4b5f-9b3b-df18d086b4af None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:46.491259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc380e3-9338-4b5f-9b3b-df18d086b4af None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:46.491444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc380e3-9338-4b5f-9b3b-df18d086b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:46.514528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9fc380e3-9338-4b5f-9b3b-df18d086b4af None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:46.515804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9fc380e3-9338-4b5f-9b3b-df18d086b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:46.525820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1136/2247] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:46:46 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:46:46.541102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:46.553084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b662c2-0b26-4165-bc69-44967627c4ec service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:46.558789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:46.559564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:46.559853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:46.560148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:46.569219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:46.570856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:46.579750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1112/2248] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:46:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 20:46:53.133457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa765d-36b5-414f-8499-9f5896007a85 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:53.134076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa765d-36b5-414f-8499-9f5896007a85 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:53.134076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa765d-36b5-414f-8499-9f5896007a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:53.182531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-bffa765d-36b5-414f-8499-9f5896007a85 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:46:53.186929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bffa765d-36b5-414f-8499-9f5896007a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:46:53.224055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1137/2249] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:46:53 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:46:53.248316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:46:53.271241 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0bb4-8c67-42bb-b35d-89092e3ea603 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:46:53.289110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:46:53.290397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:46:53.290766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:46:53.291325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:46:53.325111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:46:53.338029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:46:53.361433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1113/2250] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:03.170238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=18 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:03.353661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=67 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:04.372198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:04.372673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:04.372761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:04.392285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:04.393477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:04.401103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1138/2251] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:47:04 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:04.415020 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:04.438624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45545c-c6d8-499b-af89-e77470a8c918 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:04.445376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:04.446280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:04.446695 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:04.447061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:04.458965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:04.460626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:04.469811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1114/2252] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:06.575744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:06.577908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:06.653140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c970c-93e9-4a86-881c-6db8a4db123d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:06.657991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:06.658656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:06.659004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:06.659307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] PATH_INFO: `/v3/users/053d69835219410f9a669f3afd120263` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:06.660760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=053d69835219410f9a669f3afd120263)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:06.662686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:06.721009 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053d69835219410f9a669f3afd120263'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:06.722377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053d69835219410f9a669f3afd120263'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:06.723216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053d69835219410f9a669f3afd120263'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:06.732793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053d69835219410f9a669f3afd120263'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:06.740708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e166f9c6-ef88-4a63-bc85-3c80ca39f89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053d69835219410f9a669f3afd120263'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:06.760591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1139/2253] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:47:06 2022] DELETE /identity/v3/users/053d69835219410f9a669f3afd120263 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:06.954078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:06.969828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab994a57-ea48-4f4f-8c34-d64f25856986 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.039760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.040467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.040770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.041100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] PATH_INFO: `/v3/projects/e909b98552a841c988e49b79ba01fa64` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.042357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e909b98552a841c988e49b79ba01fa64)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.044369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.121966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e909b98552a841c988e49b79ba01fa64', 'request_id': 'req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:07.131860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e909b98552a841c988e49b79ba01fa64', 'request_id': 'req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:07.138354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e909b98552a841c988e49b79ba01fa64', 'request_id': 'req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:07.153230 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] The token cache is being invalidate because project e909b98552a841c988e49b79ba01fa64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:47:07.153595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:07.154303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6eba5e7f-b601-4a0e-97fb-9c3083d4dc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:07.159923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1115/2254] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:47:06 2022] DELETE /identity/v3/projects/e909b98552a841c988e49b79ba01fa64 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:07.162175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.162471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.162748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.185780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:07.187177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:07.251465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1140/2255] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:07.259981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.260271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.260547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.280755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:07.281955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:07.289993 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1116/2256] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:07.294399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.305857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ad56-198a-4f69-99ed-f102bd759305 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.310797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.311466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.311754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.312033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.312780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:47:07.313109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.314779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.324027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:07.328388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1141/2257] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:47:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:47:07.334983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.348218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abb2e2-f100-40da-acf1-0d1974818f28 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.356263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.357150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.357507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.357869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.358794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.361874 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.399957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1117/2258] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:47:07 2022] POST /identity/v3/projects => generated 376 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:47:07.401181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.412958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f20e0-4f11-4643-82ad-53c6f5abf0e8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.471987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.472616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.472892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.473169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.473844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.475865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.498031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1142/2259] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:47:07 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:47:07.502165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.512941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45e0a-ce3f-42b0-a5b3-5d41c5915c94 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.518365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.519124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.519497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.519775 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.520484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.522092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.534573 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1118/2260] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:07 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:47:07.537659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.548985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9bff0-428b-4daf-9413-edfc079b640c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.559131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.559806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.560107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.560367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.561077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.563386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66346-4dff-4caf-b23c-1bf04bc81594 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.575588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1143/2261] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:07 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:47:07.581414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.591870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d0cc7-322d-405a-9965-e81d4e295720 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.596951 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.597612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.597947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.598228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] PATH_INFO: `/v3/projects/0aae2e3faf47484886a5ccc86424b5c9/users/6728c782d82146648c1b1de46866476d/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.615664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aae2e3faf47484886a5ccc86424b5c9, user_id=6728c782d82146648c1b1de46866476d, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.618412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.633329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1119/2262] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:47:07 2022] PUT /identity/v3/projects/0aae2e3faf47484886a5ccc86424b5c9/users/6728c782d82146648c1b1de46866476d/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:07.645955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019232b2-ff68-4e90-9f27-6ba06a0b3463 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.646772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019232b2-ff68-4e90-9f27-6ba06a0b3463 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.646956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019232b2-ff68-4e90-9f27-6ba06a0b3463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.683041 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-019232b2-ff68-4e90-9f27-6ba06a0b3463 None None] MFA Rules not processed for user `6728c782d82146648c1b1de46866476d`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:07.684371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-019232b2-ff68-4e90-9f27-6ba06a0b3463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:07.753264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1144/2263] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:47:07.764170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:07.765903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:07.780915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:07.832407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee079e2-e017-4ef8-ade5-7e4e21dacccc admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:07.836371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:07.837002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:07.837278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:07.837549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:07.846442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:07.848124 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:07.865302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1120/2264] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:09.285737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:09.286352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:09.286352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:09.317194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] MFA Rules not processed for user `6728c782d82146648c1b1de46866476d`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:09.318458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:09.326182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1145/2265] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:09.746661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:09.748199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:09.837207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de279e1-4840-408e-8c12-c8dc7ae3e179 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:09.842767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:09.843549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:09.843928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:09.844297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:09.848044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:09.861610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:09.863939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:09.880788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1121/2266] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:09 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:13.944588 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:13.946326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:14.006961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3bac-9b48-4b48-a026-9ab061ef5ab7 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:14.011308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:14.012021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:14.012367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:14.012715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:14.014638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:14.030181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:14.085202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:14.086789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608c80-3c68-4dc2-bad6-42e24791cd93 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:14.103581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1146/2267] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:47:18.732274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:18.734017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:18.746470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9337-2b9e-4e37-a11d-ea0db66ec615 service placement] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:18.750412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:18.751069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:18.751391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:18.751748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:18.753915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:18.824767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:18.826229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:18.836479 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1122/2268] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:22.916162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94680-39c4-4d34-83fb-af4047bc4a8c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:22.917049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94680-39c4-4d34-83fb-af4047bc4a8c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:22.917493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94680-39c4-4d34-83fb-af4047bc4a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:22.939947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-05b94680-39c4-4d34-83fb-af4047bc4a8c None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:22.941916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-05b94680-39c4-4d34-83fb-af4047bc4a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:23.008040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1147/2269] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:23.024096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:23.026027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:23.075064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:23.106876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf11-ffdc-4ba8-a3f7-9a878b84a428 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:23.113749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:23.116607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:23.117056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:23.117382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:23.129246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:23.131719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:23.143333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1123/2270] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:30.866883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7246b-d96a-4a0d-93eb-372b9a5c958f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:30.867385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7246b-d96a-4a0d-93eb-372b9a5c958f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:30.867485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7246b-d96a-4a0d-93eb-372b9a5c958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:30.888904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-bad7246b-d96a-4a0d-93eb-372b9a5c958f None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:30.890161 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bad7246b-d96a-4a0d-93eb-372b9a5c958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:30.899251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1148/2271] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:30.911831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:30.922843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d302bd-5cdb-4b35-abaa-c19d8d69fca1 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:30.928492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:30.929284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:30.929572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:30.929853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:30.939635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:30.941499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:30.950949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1124/2272] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:31.501462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246af71-8f0d-4180-a576-0abab23f6ff5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:31.501733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246af71-8f0d-4180-a576-0abab23f6ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:31.502016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246af71-8f0d-4180-a576-0abab23f6ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:31.521633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5246af71-8f0d-4180-a576-0abab23f6ff5 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:31.523038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5246af71-8f0d-4180-a576-0abab23f6ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:31.530849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1149/2273] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:31.544136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:31.558651 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc199-61b3-40d1-b7f6-3fd95d848b74 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:31.565228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:31.565918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:31.566249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:31.566621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:31.577818 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:31.579555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:31.589347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1125/2274] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:31.843138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb15-5cf1-4419-82a7-3f2884be7559 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:31.843472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb15-5cf1-4419-82a7-3f2884be7559 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:31.843756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cb15-5cf1-4419-82a7-3f2884be7559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:31.863867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-01b2cb15-5cf1-4419-82a7-3f2884be7559 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:31.865062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-01b2cb15-5cf1-4419-82a7-3f2884be7559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:31.872943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1150/2275] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:31.885572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:31.896746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bffb8-41f3-4ca2-b03b-6e3bc6aabe65 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:31.904515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:31.905235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:31.905514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:31.905784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:31.917454 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:31.919159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:31.931974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1126/2276] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:32.301540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:32.301840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:32.302122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:32.327968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:32.329810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:32.339033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1151/2277] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:32.352222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:32.364305 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687962-7e09-4dbb-998c-ad9496b101e3 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:32.371195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:32.371866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:32.372144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:32.372407 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:32.381769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:32.383409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57504c4e-7eda-46e8-a635-e1bc19da5ff8 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:32.392094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1127/2278] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:34.552140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:34.621229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d7ed-978d-4656-a030-3d8c357f651b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:34.626142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:34.626838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:34.627128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:34.627451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] PATH_INFO: `/v3/users/6728c782d82146648c1b1de46866476d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:34.628652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6728c782d82146648c1b1de46866476d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:34.631574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:34.677822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:34.694708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6728c782d82146648c1b1de46866476d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:34.695525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6728c782d82146648c1b1de46866476d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:34.696206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6728c782d82146648c1b1de46866476d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:34.706330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6728c782d82146648c1b1de46866476d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:34.727269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6728c782d82146648c1b1de46866476d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:34.754029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1152/2279] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:47:34 2022] DELETE /identity/v3/users/6728c782d82146648c1b1de46866476d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:34.758673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:34.759164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:34.759474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:34.780336 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:34.781737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:34.843552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1128/2280] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:47:34.853789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:34.855246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:34.921865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8580b0-c694-4594-91cb-e8ef6485d511 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:34.928139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:34.928754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:34.929117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:34.929486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:34.944337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:34.945849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7fc6c-aa4c-4cff-bc41-66e9c1cf9cd5 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:34.955916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1153/2281] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:35.132499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.134111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:35.147030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745a8d7-a165-4d84-b9c0-e6d710159f3e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.152782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.153452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.153734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.154357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] PATH_INFO: `/v3/projects/0aae2e3faf47484886a5ccc86424b5c9` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.155730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aae2e3faf47484886a5ccc86424b5c9)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.157884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.208673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aae2e3faf47484886a5ccc86424b5c9', 'request_id': 'req-26c850fe-3a93-435e-a28e-1cb56598716a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:35.214872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aae2e3faf47484886a5ccc86424b5c9', 'request_id': 'req-26c850fe-3a93-435e-a28e-1cb56598716a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:35.220842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aae2e3faf47484886a5ccc86424b5c9', 'request_id': 'req-26c850fe-3a93-435e-a28e-1cb56598716a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:35.233558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:35.237900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] The token cache is being invalidate because project 0aae2e3faf47484886a5ccc86424b5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:47:35.238202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:35.239831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-26c850fe-3a93-435e-a28e-1cb56598716a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:47:35.241405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1129/2282] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:47:35 2022] DELETE /identity/v3/projects/0aae2e3faf47484886a5ccc86424b5c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:47:35.246870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.247211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.247612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.268062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:35.269286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:35.334403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1154/2283] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:35.402191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.402463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.402751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.424904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:35.426172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:35.435873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1130/2284] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:35.440410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.451102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaf27b-e015-4891-b86d-064f2b2c4785 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.456632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.457257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.457548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.457942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.458733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:47:35.459042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.460731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.472608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1155/2285] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:47:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:47:35.478760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.488247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882964-f801-43a3-b341-d4ffac47065d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.493513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.494133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.494418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.494697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.495480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.497473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.529283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1131/2286] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:47:35 2022] POST /identity/v3/projects => generated 378 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:47:35.535421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.545980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e238c6-578a-4267-b38e-dc91c0e1008b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.587871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:35.610529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.611193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.611514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.611816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.612511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.615151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.638362 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1156/2287] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:47:35 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:47:35.642609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.653171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b28e3a-d308-414f-ae06-4f59714912e2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.658642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.659266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.659589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.659868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.660572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.662312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.672637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1132/2288] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:47:35.676775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.687864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea4e9-cc33-416d-a52c-3761be8adc5f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.693138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.693770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.694057 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.694338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.695045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.696696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ee620-aea8-45c8-aa6a-4060fc011226 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.707245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1157/2289] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:47:35.711848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.722064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cf9de-cd61-476c-851e-f905f8ec7a69 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.730116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.731084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.731447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.732046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] PATH_INFO: `/v3/projects/c671352d2d2c475ab5c58932b6ecf5bc/users/9b5ea50e80674c9f96821af04540ba39/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.750553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c671352d2d2c475ab5c58932b6ecf5bc, user_id=9b5ea50e80674c9f96821af04540ba39, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.753261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.768767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1133/2290] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:47:35 2022] PUT /identity/v3/projects/c671352d2d2c475ab5c58932b6ecf5bc/users/9b5ea50e80674c9f96821af04540ba39/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:35.774859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078b8c-9de0-4d1c-9ce8-9526886f37db None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.774980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078b8c-9de0-4d1c-9ce8-9526886f37db None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.775261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078b8c-9de0-4d1c-9ce8-9526886f37db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.795595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4b078b8c-9de0-4d1c-9ce8-9526886f37db None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:35.796893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4b078b8c-9de0-4d1c-9ce8-9526886f37db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:35.861725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1158/2291] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:35.872376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:35.874150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:35.938393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133946e1-feda-44dd-917b-27098fb22c7e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:35.943098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:35.943791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:35.944076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:35.944376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:35.955128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:35.956657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3253f9-225f-4edd-b851-b4430d479c8c service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:35.968073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1134/2292] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:35 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:37.363152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:37.364200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:37.364636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:37.387013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] MFA Rules not processed for user `2a09fb7dd7ec47e5b37d533c3701a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:37.388610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:37.456145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1159/2293] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:40.830310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:40.830855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:40.830855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:40.860826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] MFA Rules not processed for user `9b5ea50e80674c9f96821af04540ba39`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:40.862261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:40.952849 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1135/2294] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:40.957764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:40.973829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f2c3-6b08-4277-850f-4bd0bc3db3ca None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:40.979126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:40.980000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:40.980450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:40.980870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:40.981718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:40.984024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.035094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1160/2295] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:47:40 2022] POST /identity/v3/projects => generated 380 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:47:41.039014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:41.057923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121990-0ba3-4b1f-9893-7afb7ee64276 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:41.101712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:41.149751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:41.150569 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:41.150860 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:41.151635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:41.151851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:41.154244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.194832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1136/2296] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:47:41 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:47:41.199084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:41.211062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3fb44-06d0-45b7-9a10-dc0797f1e28d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:41.216258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:41.216900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:41.217184 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:41.217455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:41.218177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:41.219828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.231261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1161/2297] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:41 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:47:41.235643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:41.246571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474a171-53fe-4f75-93c0-092650960314 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:41.251413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:41.252202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:41.252564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:41.252944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] PATH_INFO: `/v3/projects/434c8d1fa4584124a55a24da9063b260/users/a815f81cf9514b3d93963f2743aa28d7/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:41.269765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434c8d1fa4584124a55a24da9063b260, user_id=a815f81cf9514b3d93963f2743aa28d7, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:41.272639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.288553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1137/2298] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:47:41 2022] PUT /identity/v3/projects/434c8d1fa4584124a55a24da9063b260/users/a815f81cf9514b3d93963f2743aa28d7/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:41.292835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:41.303818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e6ff0-a958-45d3-9011-70ba05784ef8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:41.354787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:41.392049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:41.392700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:41.392981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:41.393255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:41.394000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:41.395677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047ac7-942f-494f-8b9d-39dacddbaf85 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.406684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1162/2299] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:47:41 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:47:41.411118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:41.423225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52fb4d-bc20-45d5-95c4-2930a2a5c4a3 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:41.428337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:41.429025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:41.429304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:41.429577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] PATH_INFO: `/v3/projects/434c8d1fa4584124a55a24da9063b260/users/a815f81cf9514b3d93963f2743aa28d7/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:41.431614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=434c8d1fa4584124a55a24da9063b260, user_id=a815f81cf9514b3d93963f2743aa28d7, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:41.434272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:41.445892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1138/2300] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:47:41 2022] PUT /identity/v3/projects/434c8d1fa4584124a55a24da9063b260/users/a815f81cf9514b3d93963f2743aa28d7/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:47:48.930490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a36386-051b-46b3-ac8b-c2bd8bf744ce None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:48.931529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a36386-051b-46b3-ac8b-c2bd8bf744ce None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:48.931908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a36386-051b-46b3-ac8b-c2bd8bf744ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:48.984659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-33a36386-051b-46b3-ac8b-c2bd8bf744ce None None] MFA Rules not processed for user `a815f81cf9514b3d93963f2743aa28d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:48.989755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-33a36386-051b-46b3-ac8b-c2bd8bf744ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:49.069012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1163/2301] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:49.214366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:47:49.216390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:49.310989 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973a4a-589c-45e1-9234-0711fa31a7cf admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:47:49.317211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:47:49.318434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:49.318769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:49.319179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:49.408416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:47:49.410106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41033d3-0a5d-45f9-802c-b0820e77a6fe service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:47:49.420784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1139/2302] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:47:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:47:59.065755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=49 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:59.133672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021771bf-619a-4779-8916-48871f28e587 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:47:59.133964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021771bf-619a-4779-8916-48871f28e587 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:47:59.134246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021771bf-619a-4779-8916-48871f28e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:47:59.154868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-021771bf-619a-4779-8916-48871f28e587 None None] MFA Rules not processed for user `8e1baad75342476aa0c64bda0414e334`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:47:59.156096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-021771bf-619a-4779-8916-48871f28e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:47:59.215595 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1164/2303] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:47:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:47:59.416433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:09.208410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=25 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:10.688384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542e6c8-97d0-4cec-8ab5-468e5fbfa353 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:48:10.688959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542e6c8-97d0-4cec-8ab5-468e5fbfa353 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:48:10.688959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542e6c8-97d0-4cec-8ab5-468e5fbfa353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:48:10.713754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-f542e6c8-97d0-4cec-8ab5-468e5fbfa353 None None] MFA Rules not processed for user `9b5ea50e80674c9f96821af04540ba39`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:48:10.715703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f542e6c8-97d0-4cec-8ab5-468e5fbfa353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:48:10.726739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1140/2304] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:48:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:48:20.704191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:27.611075 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021771bf-619a-4779-8916-48871f28e587 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:48:27.679405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021771bf-619a-4779-8916-48871f28e587 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:48:27.684081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:48:27.684721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:48:27.685000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:48:27.685297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:48:27.695943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:48:27.697448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:48:27.707624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1165/2305] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:48:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:48:32.981798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:48:32.982300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:48:32.982464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:48:33.002113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] MFA Rules not processed for user `44ac4775be0244df8fa0ee51a765c03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:48:33.003314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:48:33.060557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1141/2306] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:48:37.703251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=26 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:43.052697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=25 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:55.980015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:48:55.981587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:48:55.993878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f737c8-a624-48bf-8c3b-ef3d7f93ae97 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:48:55.998061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:48:55.998681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:48:55.998968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:48:55.999255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:48:56.001429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:48:56.017520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:48:56.018893 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee191b1c-04d8-407c-8bf5-8ef1464b1b8b service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:48:56.033562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1166/2307] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:48:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:48:57.238409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:48:57.250635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1640afc-d57e-4ee4-9882-b4d4ce8630eb None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:48:57.252867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:48:57.253492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:48:57.253776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:48:57.254052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:48:57.256005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:48:57.270057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:48:57.271552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:48:57.284317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1142/2308] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:48:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:04.254328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:04.254932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:04.254932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:04.275337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] MFA Rules not processed for user `396a79cbb4e9494791422713c596bc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:04.276607 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:04.334594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1167/2309] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:07.278879 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=6 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:08.156126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:08.157497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:08.172065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfb425-4140-415b-80f8-e96e9de85080 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:08.179426 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:08.180105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:08.180471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:08.180728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:08.182869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:08.194287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:08.196146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607abd-77cf-42d5-8634-f6a02c336433 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:08.205459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1143/2310] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:08.374145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:08.388822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1798-b51f-42ea-a8bd-dbae48608830 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:08.394439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:08.395072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:08.395433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:08.395795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:08.397865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:08.410550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:08.412269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf696ea8-74d9-44e7-8d74-b2b9cf6854ca service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:08.422913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1168/2311] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:18.200926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=6 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:18.417686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=37 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:21.114117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:21.114719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:21.114719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:21.135591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] MFA Rules not processed for user `2a09fb7dd7ec47e5b37d533c3701a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:21.136827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:21.201925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1144/2312] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:30.095966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767156-74f5-474c-a18b-ffdce9a21d02 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:30.097063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767156-74f5-474c-a18b-ffdce9a21d02 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:30.097745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767156-74f5-474c-a18b-ffdce9a21d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:30.118747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-01767156-74f5-474c-a18b-ffdce9a21d02 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:30.120515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-01767156-74f5-474c-a18b-ffdce9a21d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:30.187657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1169/2313] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:30.241548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:30.244101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:30.321760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad268ef-bb40-4a50-a8b7-c40863fc238b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:30.328960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:30.329692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:30.330043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:30.330387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:30.339884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:30.341591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:30.359380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1145/2314] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:49:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:49:30.643954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:30.644261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:30.644636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:30.671903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] MFA Rules not processed for user `8e1baad75342476aa0c64bda0414e334`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:30.673135 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:30.681000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1170/2315] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:30.993663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:31.002936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959b3ea-6d2a-4b7c-ba12-faef135a7398 service swift] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:31.007216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:31.008322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:31.008817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:31.009100 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:31.011019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:31.021092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:31.022561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:31.031101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1146/2316] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:31.352382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:31.354601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:31.441733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a8041-3df6-4e16-9c58-e7e221c40b3c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:31.447241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:31.447906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:31.448186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:31.448460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:31.450256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:31.461886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:31.463528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:31.473463 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1171/2317] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:31.640868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:31.651295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601cab-1a95-4aa2-ba7b-8d56be711141 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:31.656523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:31.657430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:31.657950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:31.658452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:31.660554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:31.671197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:31.672684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:31.682489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1147/2318] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:32.721143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:32.742528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b7c99-46f2-412b-9837-15bd6fb2cf6a service placement] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:32.758210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:32.758995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:32.759274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:32.759577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:32.761425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:32.778882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:32.781371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:32.804731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1172/2319] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:34.437803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:34.452466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59fb1-6cc8-4ec5-b5d2-4fdcefc3997e service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:34.457987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:34.458645 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:34.462179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:34.462179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:34.476714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:34.498539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:34.502688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:34.524144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1148/2320] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:38.772330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:38.774502 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:38.861943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a43fa-9880-4a0c-ad50-89348da64e5f service nova] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:38.867020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:38.868052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:38.868339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:38.868622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] PATH_INFO: `/v3/users/30986eb76c6d4434b9c92f26d8418fbb` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:38.869852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30986eb76c6d4434b9c92f26d8418fbb)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:38.871834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:38.888932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:38.924191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30986eb76c6d4434b9c92f26d8418fbb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:38.924849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30986eb76c6d4434b9c92f26d8418fbb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:38.925451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30986eb76c6d4434b9c92f26d8418fbb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:38.935324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30986eb76c6d4434b9c92f26d8418fbb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:38.944040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30986eb76c6d4434b9c92f26d8418fbb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:38.967475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1173/2321] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:49:38 2022] DELETE /identity/v3/users/30986eb76c6d4434b9c92f26d8418fbb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:49:39.150959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:39.163066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a73012-386d-489b-9164-4355591b7c8c service placement] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:39.219836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:39.226833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:39.227535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:39.227965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:39.228251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] PATH_INFO: `/v3/projects/958a479cb6904c1bb6e6868c2b061e02` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:39.229443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=958a479cb6904c1bb6e6868c2b061e02)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:39.231455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:39.281545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958a479cb6904c1bb6e6868c2b061e02', 'request_id': 'req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.287735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958a479cb6904c1bb6e6868c2b061e02', 'request_id': 'req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.293942 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958a479cb6904c1bb6e6868c2b061e02', 'request_id': 'req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.309567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] The token cache is being invalidate because project 958a479cb6904c1bb6e6868c2b061e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:49:39.309859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.310825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.312682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1149/2322] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:49:39 2022] DELETE /identity/v3/projects/958a479cb6904c1bb6e6868c2b061e02 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:49:39.317001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:39.318470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:39.332967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6595-654f-4209-9971-d5d428a54e80 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:39.396935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:39.397601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:39.397881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:39.398248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] PATH_INFO: `/v3/users/9d81a3ced50645ebac427282eab51e47` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:39.400173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d81a3ced50645ebac427282eab51e47)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:39.402646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:39.460749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d81a3ced50645ebac427282eab51e47'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.461821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d81a3ced50645ebac427282eab51e47'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.465349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d81a3ced50645ebac427282eab51e47'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.476936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d81a3ced50645ebac427282eab51e47'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.484997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d81a3ced50645ebac427282eab51e47'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.505639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1174/2323] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:49:39 2022] DELETE /identity/v3/users/9d81a3ced50645ebac427282eab51e47 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:49:39.702435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:39.704011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:39.718048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5eeb3-d024-43d7-8eb1-6ffc29bf6dfc admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:39.779380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:39.780052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:39.780343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:39.780620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] PATH_INFO: `/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:39.781810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d43fb32d2a4e29936b9e5e9fb4be0a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:39.783820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:39.832736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d43fb32d2a4e29936b9e5e9fb4be0a', 'request_id': 'req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.839745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d43fb32d2a4e29936b9e5e9fb4be0a', 'request_id': 'req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.846280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d43fb32d2a4e29936b9e5e9fb4be0a', 'request_id': 'req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.862233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] The token cache is being invalidate because project f5d43fb32d2a4e29936b9e5e9fb4be0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:49:39.862559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.863823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0b3d88b-0a77-49aa-ba38-4c3ab2d4fa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:49:39.865517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1150/2324] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:49:39 2022] DELETE /identity/v3/projects/f5d43fb32d2a4e29936b9e5e9fb4be0a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:49:46.095330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:46.098029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:46.113859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:46.181425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb541a1-3afb-4d1e-a54b-30fdada50d53 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:46.247149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:46.247839 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:46.248114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:46.248382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:46.250204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:46.263815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:46.265685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b800-e97b-4475-a4c4-af407246fc59 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:46.277825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1175/2325] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:49.858406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:52.705349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:52.706040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:52.706040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] PATH_INFO: `/` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:52.707476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1151/2326] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:49:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:49:52.713673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e311a-46fe-41ac-aeed-4c5886ea6d18 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:52.714156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e311a-46fe-41ac-aeed-4c5886ea6d18 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:52.714269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e311a-46fe-41ac-aeed-4c5886ea6d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:52.735967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-de8e311a-46fe-41ac-aeed-4c5886ea6d18 None None] MFA Rules not processed for user `5a419e6d58c24957a62b648015ffaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:52.737197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-de8e311a-46fe-41ac-aeed-4c5886ea6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:52.792162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1176/2327] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:52.804247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:52.806969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:52.821042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4aebf0-377d-4618-af78-8cfa724c25f6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:52.824677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:52.825320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:52.825612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:52.825883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:52.833399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:52.834836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc159-dd16-42bf-8e59-f5289a65fcbb service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:52.842754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1152/2328] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:52.934349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:52.934639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:52.934916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] PATH_INFO: `/` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:52.936332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1177/2329] 10.222.0.100 () {54 vars in 926 bytes} [Fri Aug 5 20:49:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 05 20:49:52.942006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf1a2-5875-434a-9691-bc7fb434a8de None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:52.942300 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf1a2-5875-434a-9691-bc7fb434a8de None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:52.942606 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf1a2-5875-434a-9691-bc7fb434a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:52.964415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a00cf1a2-5875-434a-9691-bc7fb434a8de None None] MFA Rules not processed for user `7cc303860598497f85766448bbdd7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:52.965652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a00cf1a2-5875-434a-9691-bc7fb434a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:52.976656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1153/2330] 10.222.0.100 () {58 vars in 1023 bytes} [Fri Aug 5 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:52.991623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:52.994236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:53.010551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cd392-0766-4f88-b2f0-50bd5b4dc296 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:53.015147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:53.015803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:53.016088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:53.016359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:53.028778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:53.030246 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:53.041524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1178/2331] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:49:54.229213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:54.229720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:54.229832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:54.250574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:49:54.251931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:54.314269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1154/2332] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:49:54.327963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:54.329531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:54.366487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:54.403523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3100ef-a3c5-4707-bb7d-1509e8d8d1dd service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:54.409559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:54.410189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:54.410499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:54.410779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:54.420942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:54.422553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffba772-3a2a-4717-83d5-78ebe851ac71 service swift] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:54.430982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1179/2333] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:49:54.640750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:49:54.642558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:54.679484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafe71-1d10-4144-b677-59f985237087 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:49:54.690149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:49:54.690962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:49:54.691342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:49:54.691715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:49:54.694328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:49:54.743260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:49:54.746882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:49:54.776619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1155/2334] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:49:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:04.427594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=17 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:04.762307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=40 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:10.837855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:10.838397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:10.838397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:10.859410 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:10.860641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:10.869224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1180/2335] 10.222.0.100 () {58 vars in 1014 bytes} [Fri Aug 5 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:10.881718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:10.896972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8bb08-7d7e-4afc-bd71-377c370a9833 service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:10.903679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:10.904315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:10.904603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:10.904881 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:10.915198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:10.917283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625ca3-5689-4b9b-aaee-8f810ea5407a service swift] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:10.926540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1156/2336] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:50:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:20.854193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:20.922882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=6 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:27.986464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:28.008665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553c66-6790-4466-b947-49f8620be1fe None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:28.023454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:28.024377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:28.024812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:28.025364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:28.028950 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:28.045615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:28.048534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:28.064476 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1181/2337] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:28.266438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:28.267324 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:28.267803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:28.294575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] MFA Rules not processed for user `7fb919f2578a4e57b25f27b97822e0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:28.296510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:28.308475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1157/2338] 10.222.0.100 () {58 vars in 972 bytes} [Fri Aug 5 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:28.323480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:28.335295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dd4ea-170f-4f27-886d-7285adc0010a service nova] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:28.342475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f9d739145b45f4a689648350d9ecda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:28.343268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:28.343586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:28.343863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:28.353572 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:28.355318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:28.364538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1182/2339] 10.222.0.100 () {60 vars in 1389 bytes} [Fri Aug 5 20:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:38.287790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:38.360712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=12 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:42.958609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:42.972845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c81e2-db41-43fe-8d5e-2e79cb6cb31f None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:42.974767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:42.977255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:42.977920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:42.978204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:42.978452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:42.980589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:42.987811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad7480-ca20-4f02-982a-47999bfdb3c8 service swift] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:42.994126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:42.994889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:42.995179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:42.995581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:42.997495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:43.042730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:43.044252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:43.054346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1158/2340] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:43.066975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:43.066975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb06f68-331b-46c4-969f-44500d5af31b service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:43.077128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1183/2341] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:45.495490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:45.504694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af94158-2088-4062-8753-44a3c2700f98 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:45.511057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:45.511976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:45.512481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:45.513638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:45.517815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:45.622712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:45.624425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:45.635083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1159/2342] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:47.332214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:47.332733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:47.332733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:47.352820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] MFA Rules not processed for user `9b5ea50e80674c9f96821af04540ba39`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:47.354156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:47.413223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1184/2343] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:49.469179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:49.472116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:49.506310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a668-2ec6-4b1a-ad7c-39d50e92b2ef service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:49.511543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:49.512213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:49.512496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:49.512772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] PATH_INFO: `/v3/users/2a09fb7dd7ec47e5b37d533c3701a3a2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:49.513970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a09fb7dd7ec47e5b37d533c3701a3a2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:49.516281 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:49.622962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a09fb7dd7ec47e5b37d533c3701a3a2'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:49.661724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a09fb7dd7ec47e5b37d533c3701a3a2'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:49.665588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a09fb7dd7ec47e5b37d533c3701a3a2'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:49.690246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a09fb7dd7ec47e5b37d533c3701a3a2'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:49.743423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d6e786f-6077-4547-89f0-cb79d121457b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a09fb7dd7ec47e5b37d533c3701a3a2'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:49.759403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1160/2344] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:50:49 2022] DELETE /identity/v3/users/2a09fb7dd7ec47e5b37d533c3701a3a2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:50:50.016270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.029341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ce63-8fb3-4a8d-a6d4-ee528f4ed95e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.122712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.123292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.124571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.124571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] PATH_INFO: `/v3/projects/80b5e8457f2d47b7a7c0d2856a513b77` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.125787 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b5e8457f2d47b7a7c0d2856a513b77)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.127999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.201624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:50.207318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b5e8457f2d47b7a7c0d2856a513b77', 'request_id': 'req-bc35f9de-95d8-4843-adf0-d480ddde7abf'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:50.215884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b5e8457f2d47b7a7c0d2856a513b77', 'request_id': 'req-bc35f9de-95d8-4843-adf0-d480ddde7abf'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:50.223689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b5e8457f2d47b7a7c0d2856a513b77', 'request_id': 'req-bc35f9de-95d8-4843-adf0-d480ddde7abf'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:50.240327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] The token cache is being invalidate because project 80b5e8457f2d47b7a7c0d2856a513b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:50:50.240546 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:50.241482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bc35f9de-95d8-4843-adf0-d480ddde7abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:50.243848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1185/2345] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:50:50 2022] DELETE /identity/v3/projects/80b5e8457f2d47b7a7c0d2856a513b77 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:50:50.248688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.248979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.249469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.260117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:50.277654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:50.279604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:50.367238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1161/2346] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:50.375923 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.376580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.377037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.412447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:50.413788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:50.429301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1186/2347] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:50.433351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.451083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c762b1-4700-47f9-becc-8d381241deb8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.458617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.459003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.459291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.459591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.460303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:50:50.460608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.462245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.475477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1162/2348] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:50:50.480379 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.490070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb3a6-46d6-43ee-81a9-2762e4d9d57d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.495162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.496808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.497289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.497765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.499386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.502422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.540333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1187/2349] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:50:50 2022] POST /identity/v3/projects => generated 384 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:50:50.544527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.556625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b434f41-fefa-4564-b963-c875b1f41b21 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.623200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.625287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.625757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.626203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.627897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.629880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.658397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1163/2350] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:50:50 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:50:50.662600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.676540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3333-cea6-4802-9e1a-ad4527bab7c2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.682846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.683783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.684122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.684460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.686201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.689109 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.705288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1188/2351] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:50:50 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:50:50.706107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.718967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7426d3-09ea-4f6f-8a0c-6c338e3676f0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.725131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.725985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.726292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.726613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.727577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.729234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b81e73-730e-490e-b10e-3d54e5234478 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.741096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1164/2352] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:50:50 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:50:50.745335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.755795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4c166-332e-406b-9c7c-3971e2c8a3d0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:50.761264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:50.761947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.762228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.762513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] PATH_INFO: `/v3/projects/2b483d1095ff4ac8845d0bb7325ae382/users/e9df11ae71d2493f82644ac4ed1a95b0/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.781115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b483d1095ff4ac8845d0bb7325ae382, user_id=e9df11ae71d2493f82644ac4ed1a95b0, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:50.795397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:50.808352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1189/2353] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:50:50 2022] PUT /identity/v3/projects/2b483d1095ff4ac8845d0bb7325ae382/users/e9df11ae71d2493f82644ac4ed1a95b0/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:50:50.820891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:50.821466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:50.821904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:50.854786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] MFA Rules not processed for user `e9df11ae71d2493f82644ac4ed1a95b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:50.856179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:50.969956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:50.970720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1165/2354] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:50.983943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:50.986128 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:51.113438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82edfa-44fe-4d6d-8b50-dd9db762d8f3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:51.119632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:51.120351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:51.120584 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:51.120920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:51.133152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:51.134881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bf9a3-e200-4305-be96-5bd47d57d9d9 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:51.147524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1190/2355] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:50:58.628397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:58.696092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2afa0-58ea-4e65-8685-f9b5eab649ee None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:58.702675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:58.703497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:58.703819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:58.704258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] PATH_INFO: `/v3/users/e9df11ae71d2493f82644ac4ed1a95b0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:58.705704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9df11ae71d2493f82644ac4ed1a95b0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:58.707799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:58.760601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9df11ae71d2493f82644ac4ed1a95b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:58.767600 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9df11ae71d2493f82644ac4ed1a95b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:58.768266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9df11ae71d2493f82644ac4ed1a95b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:58.780332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9df11ae71d2493f82644ac4ed1a95b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:58.792949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9df11ae71d2493f82644ac4ed1a95b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:58.799180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1166/2356] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:50:58 2022] DELETE /identity/v3/users/e9df11ae71d2493f82644ac4ed1a95b0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:50:58.803929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cc53-4bca-4567-8431-04014c30babe None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:58.804444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cc53-4bca-4567-8431-04014c30babe None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:58.804561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cc53-4bca-4567-8431-04014c30babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:58.827818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6762cc53-4bca-4567-8431-04014c30babe None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:58.829536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6762cc53-4bca-4567-8431-04014c30babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:58.877760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:58.895860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1191/2357] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:50:58.903221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:58.904827 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:58.979114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada424-dc0a-4439-8195-059020b04cab admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:58.982771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:58.983438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:58.983721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:58.983992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:58.993414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:58.994852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.010592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1167/2358] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:50:59.011337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762cc53-4bca-4567-8431-04014c30babe None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.021811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762cc53-4bca-4567-8431-04014c30babe None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.026357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.026969 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.027237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.027561 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.035390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:59.051348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.052847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877d45d-5d09-4053-b4f5-28f4e5608867 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.064554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1192/2359] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:50:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:50:59.416647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.418185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:59.440526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79473b-a789-40a5-9059-9bdd1fadb89c service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.447226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.448125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.448476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.448822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] PATH_INFO: `/v3/projects/2b483d1095ff4ac8845d0bb7325ae382` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.450233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b483d1095ff4ac8845d0bb7325ae382)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.452329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.473051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:59.513196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b483d1095ff4ac8845d0bb7325ae382', 'request_id': 'req-3118d763-e103-48ab-b4e5-9e4866c81476'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:59.523602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b483d1095ff4ac8845d0bb7325ae382', 'request_id': 'req-3118d763-e103-48ab-b4e5-9e4866c81476'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:59.532014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b483d1095ff4ac8845d0bb7325ae382', 'request_id': 'req-3118d763-e103-48ab-b4e5-9e4866c81476'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:59.553705 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] The token cache is being invalidate because project 2b483d1095ff4ac8845d0bb7325ae382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:50:59.554095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:59.554996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3118d763-e103-48ab-b4e5-9e4866c81476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:50:59.562502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1168/2360] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:50:59 2022] DELETE /identity/v3/projects/2b483d1095ff4ac8845d0bb7325ae382 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:50:59.565035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.565324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.565602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.588459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:59.589598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:59.665797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1193/2361] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:59.673979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.674566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.674566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.695389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:50:59.696634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:50:59.707399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1169/2362] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:50:59.712713 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.721892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c252-95ab-40f7-ab0d-4f6f123e9078 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.726656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.727296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.727625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.727904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.728637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:50:59.728979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.730562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.746235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1194/2363] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:50:59.747743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.758010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038653a-ed06-4151-81bc-431ad4dbfd62 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.762953 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.763735 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.763962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.764245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.764969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.766963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.813991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1170/2364] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:50:59 2022] POST /identity/v3/projects => generated 406 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:50:59.824846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.836170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad4d1-ecca-4d6b-ab8a-912400859e89 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.901986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.902639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.902941 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.903207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.903999 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.906138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.934534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1195/2365] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:50:59 2022] POST /identity/v3/users => generated 304 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:50:59.936154 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.947445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def30ce1-3661-4f74-ad14-9ceb257e19e6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.952035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.952663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.952940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.953211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.954251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.955908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:50:59.968673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1171/2366] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:50:59 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:50:59.972760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:50:59.983377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-01b2-4665-8445-491d1a7c0de8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:50:59.988949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:50:59.989712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:50:59.990005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:50:59.990281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:50:59.991031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:50:59.992728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75f187-9a08-4c0c-8fa9-ab2bdc7089ec admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.004491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1196/2367] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:50:59 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:00.010229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.021428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737236-94b1-4120-a67b-d19ffe0bb6ad admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.026712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.027446 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.027776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.028081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] PATH_INFO: `/v3/projects/421124f5fde6407c934796e791fca168/users/9ef549674d2c4489bf0a5d8e25de8815/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.044634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=421124f5fde6407c934796e791fca168, user_id=9ef549674d2c4489bf0a5d8e25de8815, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.047606 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.062145 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1172/2368] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:00 2022] PUT /identity/v3/projects/421124f5fde6407c934796e791fca168/users/9ef549674d2c4489bf0a5d8e25de8815/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:00.076451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.076741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.077052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.106660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] MFA Rules not processed for user `9ef549674d2c4489bf0a5d8e25de8815`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:00.107934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:00.148139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:00.179516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1197/2369] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3292 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:00.184136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.248174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792932-27e3-4b47-8dbd-fd7020104c7d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.253423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.254057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.254345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.254628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.255308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.257409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.288091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1173/2370] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:00 2022] POST /identity/v3/projects => generated 406 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:00.292633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.304059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7f4a-dffa-4216-a1d2-b6f99c327179 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.362858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.363665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.363947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.364225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.364902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.366928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.391170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1198/2371] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:00 2022] POST /identity/v3/users => generated 310 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:00.395610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.408321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225135b5-16c0-40dd-8885-ee6b7215cd96 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.413793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.414441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.414727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.414999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.415825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.417656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.431470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1174/2372] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:00 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:00.435555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.447233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ba02-1bf3-4c55-8dff-f6f75932684d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.458378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.459329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.459329 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.459675 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] PATH_INFO: `/v3/projects/85b237ee1a5849398e1101befb967b2a/users/0ad0cd2dc6e441a0a7344c8058c0edaa/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.479689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b237ee1a5849398e1101befb967b2a, user_id=0ad0cd2dc6e441a0a7344c8058c0edaa, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.482428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.509183 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1199/2373] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:00 2022] PUT /identity/v3/projects/85b237ee1a5849398e1101befb967b2a/users/0ad0cd2dc6e441a0a7344c8058c0edaa/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:00.510251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.522328 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57e9fe-eedf-4327-8c1c-e399b2277e49 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.540595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:00.598201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.598945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.599329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.599709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.600506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.602199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e61f-537b-478b-ab10-175478376512 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.620847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1175/2374] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:00 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:00.622108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.633268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717675-15e3-43b7-a20c-bc18a9d4d548 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.637968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.638676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.638953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.639223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] PATH_INFO: `/v3/projects/85b237ee1a5849398e1101befb967b2a/users/0ad0cd2dc6e441a0a7344c8058c0edaa/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.641241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b237ee1a5849398e1101befb967b2a, user_id=0ad0cd2dc6e441a0a7344c8058c0edaa, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.644038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.655201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1200/2375] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:00 2022] PUT /identity/v3/projects/85b237ee1a5849398e1101befb967b2a/users/0ad0cd2dc6e441a0a7344c8058c0edaa/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:00.666702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.667267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.667582 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.701866 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] MFA Rules not processed for user `0ad0cd2dc6e441a0a7344c8058c0edaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:00.703178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:00.791349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1176/2376] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:00.805318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:00.807811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:00.879527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff75a2-5b23-4559-bccb-008385c590f2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:00.884252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:00.884802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:00.885086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:00.885361 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:00.902531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:00.904072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191b8d7-3a19-40e0-9821-ad7cec222d02 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:00.914429 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1201/2377] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:00 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:01.076112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:01.163019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525c0b-46f5-4fa6-b71d-7812fbb8b315 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:01.168783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:01.170292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:01.170292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:01.170292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] PATH_INFO: `/v3/users/9ef549674d2c4489bf0a5d8e25de8815` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:01.171690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef549674d2c4489bf0a5d8e25de8815)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:01.175222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:01.225067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:01.233983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef549674d2c4489bf0a5d8e25de8815'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.244384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef549674d2c4489bf0a5d8e25de8815'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.245134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef549674d2c4489bf0a5d8e25de8815'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.254542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef549674d2c4489bf0a5d8e25de8815'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.271897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef549674d2c4489bf0a5d8e25de8815'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.282469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1177/2378] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:01 2022] DELETE /identity/v3/users/9ef549674d2c4489bf0a5d8e25de8815 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:01.288185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:01.288185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:01.288185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:01.308027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:01.309486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:01.345571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:01.383055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1202/2379] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:01.393385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:01.395041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:01.461346 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7d90-8a15-45c7-88c4-8c20f50d6e18 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:01.465120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:01.465752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:01.466034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:01.466304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:01.476583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:01.478034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:01.491439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1178/2380] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:01.781569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:01.783280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:01.803577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f73c5-fdf1-48ae-abcc-1ab24f5d155d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:01.813030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:01.814079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:01.814079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:01.814306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] PATH_INFO: `/v3/projects/421124f5fde6407c934796e791fca168` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:01.816094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=421124f5fde6407c934796e791fca168)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:01.818176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:01.868104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421124f5fde6407c934796e791fca168', 'request_id': 'req-a0bf0f25-bc38-499f-93b2-298e9c582bae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.874378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421124f5fde6407c934796e791fca168', 'request_id': 'req-a0bf0f25-bc38-499f-93b2-298e9c582bae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.880689 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421124f5fde6407c934796e791fca168', 'request_id': 'req-a0bf0f25-bc38-499f-93b2-298e9c582bae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.899904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] The token cache is being invalidate because project 421124f5fde6407c934796e791fca168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:01.900253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.901258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:01.903046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1203/2381] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:01 2022] DELETE /identity/v3/projects/421124f5fde6407c934796e791fca168 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:01.907146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:01.920220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440553-1b3e-4be1-bc3a-ee3673a7b8b0 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:02.025455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:02.026634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:02.026781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:02.027714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] PATH_INFO: `/v3/users/0ad0cd2dc6e441a0a7344c8058c0edaa` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:02.029523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad0cd2dc6e441a0a7344c8058c0edaa)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:02.031985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:02.073477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:02.075556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:02.115215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad0cd2dc6e441a0a7344c8058c0edaa'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:02.128633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad0cd2dc6e441a0a7344c8058c0edaa'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:02.129584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad0cd2dc6e441a0a7344c8058c0edaa'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:02.134596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:02.142429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad0cd2dc6e441a0a7344c8058c0edaa'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:02.154824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf0f25-bc38-499f-93b2-298e9c582bae admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:02.159199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:02.159906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:02.160193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:02.160473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:02.161453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad0cd2dc6e441a0a7344c8058c0edaa'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:02.162347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:02.168439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1179/2382] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:01 2022] DELETE /identity/v3/users/0ad0cd2dc6e441a0a7344c8058c0edaa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:02.176586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:02.178234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:02.192437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1204/2383] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:02.825871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:02.829762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:02.897037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:02.902110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:02.936390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a9b2-f3a6-4d64-b917-be0800ae0c9a service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:02.949502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b40d-3f0f-4c2e-82e2-660ec2a63aee admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:02.956042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:02.956737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:02.957949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:02.958233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:02.961033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:02.980530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:02.983209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:02.996067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1180/2384] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:02 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:03.054903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.055866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.056320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.056801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] PATH_INFO: `/v3/users/8e1baad75342476aa0c64bda0414e334` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.058306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1baad75342476aa0c64bda0414e334)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.060711 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.062833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:03.124327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1baad75342476aa0c64bda0414e334'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.125807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1baad75342476aa0c64bda0414e334'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.126443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1baad75342476aa0c64bda0414e334'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.137844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1baad75342476aa0c64bda0414e334'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.150385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1baad75342476aa0c64bda0414e334'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.171954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1205/2385] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:02 2022] DELETE /identity/v3/users/8e1baad75342476aa0c64bda0414e334 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:03.262456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.264512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.293943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de299-17b4-4958-9388-f012dd0f3117 service placement] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:03.366367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.367073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.367405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.367768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] PATH_INFO: `/v3/projects/85b237ee1a5849398e1101befb967b2a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.369189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b237ee1a5849398e1101befb967b2a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.371434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.387449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.388995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.434456 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b237ee1a5849398e1101befb967b2a', 'request_id': 'req-897bf387-8514-4b25-aff9-036550111c5c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.442139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b237ee1a5849398e1101befb967b2a', 'request_id': 'req-897bf387-8514-4b25-aff9-036550111c5c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.444897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9411-3b76-41b5-8a31-15dae6e4e477 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:03.448373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b237ee1a5849398e1101befb967b2a', 'request_id': 'req-897bf387-8514-4b25-aff9-036550111c5c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.460948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:03.466950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] The token cache is being invalidate because project 85b237ee1a5849398e1101befb967b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:03.467519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.469275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-897bf387-8514-4b25-aff9-036550111c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.471781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1181/2386] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:03 2022] DELETE /identity/v3/projects/85b237ee1a5849398e1101befb967b2a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:03.476593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab1a3-c8b9-43c6-9316-7fd87c445d29 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.477358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab1a3-c8b9-43c6-9316-7fd87c445d29 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.477551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab1a3-c8b9-43c6-9316-7fd87c445d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.501810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9daab1a3-c8b9-43c6-9316-7fd87c445d29 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:03.503215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9daab1a3-c8b9-43c6-9316-7fd87c445d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.546579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.548073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.548574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.549104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] PATH_INFO: `/v3/projects/8b67138a484f481099c562d7e3ca8401` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.551554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b67138a484f481099c562d7e3ca8401)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.555754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.593034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1182/2387] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:03.601371 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.601666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.602431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.620963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b67138a484f481099c562d7e3ca8401', 'request_id': 'req-773f5fdd-498e-4840-9f00-6893b2889957'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.626751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:03.629077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.630206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b67138a484f481099c562d7e3ca8401', 'request_id': 'req-773f5fdd-498e-4840-9f00-6893b2889957'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.638453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b67138a484f481099c562d7e3ca8401', 'request_id': 'req-773f5fdd-498e-4840-9f00-6893b2889957'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.654606 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] The token cache is being invalidate because project 8b67138a484f481099c562d7e3ca8401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:03.655129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.655996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-773f5fdd-498e-4840-9f00-6893b2889957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:03.657910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1206/2388] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:03 2022] DELETE /identity/v3/projects/8b67138a484f481099c562d7e3ca8401 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:03.662722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20a5a-9a28-4fa7-9498-a0a34900829c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.663007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20a5a-9a28-4fa7-9498-a0a34900829c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.663285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20a5a-9a28-4fa7-9498-a0a34900829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.686784 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d5c20a5a-9a28-4fa7-9498-a0a34900829c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:03.688196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d5c20a5a-9a28-4fa7-9498-a0a34900829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.692844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:03.703412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1183/2389] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:03.706409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.720859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41613e-ff16-4602-aaed-93e61e69b62c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:03.726465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.727115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.727437 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.727723 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.728444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:03.728755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.730664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.748719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1184/2390] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:03.750795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.765910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bca8e6-0872-4799-8163-03d06a8b4daa admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:03.771836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.773026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.773322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.773608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.774909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.778476 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.789865 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1207/2391] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:03.803045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.805593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.806145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.826127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1185/2392] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/projects => generated 384 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:03.840801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:03.842522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:03.843831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.938090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1208/2393] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:03.942782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:03.953434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a3f0-5630-42bf-b928-bc23ee2adf56 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:03.965056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:03.965786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:03.966105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:03.966414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:03.967558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:03.967558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:03.971873 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:03.998896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1209/2394] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:03.999128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090fd44-cd33-400f-9ed1-78c123e58502 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.005107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.009790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.010089 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.010887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.010887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.011262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.013270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.024830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:04.033404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad31-b903-4f65-a6c2-520a45663550 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.038782 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.039569 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.040698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.040698 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.041416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.043734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.047604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1186/2395] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:04.051559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.064497 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312f43-d355-4a49-8543-d7823b42df7b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.070972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.071762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.072041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.072845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.073766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.075536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.087404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1187/2396] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:04.091707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.093453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1210/2397] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:03 2022] POST /identity/v3/projects => generated 374 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:04.097835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.106440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9f3f-0254-4ee8-af04-d0d3dafef490 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.173358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49626-371b-4053-b83e-bf430d78f808 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.178667 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.179457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.179842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.180237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.181012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.182682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.183317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.183488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.183626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.183908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.184613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.186193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.206452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1188/2398] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:04.208279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.219432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1211/2399] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:04.219807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968124-8abb-43a2-948f-7046760f9add admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.221686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.226607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.227320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.227693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.228109 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] PATH_INFO: `/v3/projects/4e35d6b41be14ec6805649ce6e05282d/users/876bcfc66f514622bc9ae5857145d627/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.231558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:04.238383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69642d1-b123-4427-92e1-db9dbab6a371 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.246710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.247715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.248154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.248377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e35d6b41be14ec6805649ce6e05282d, user_id=876bcfc66f514622bc9ae5857145d627, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.248766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.249692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.252393 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf2248-0236-4e40-9721-2d79ee0693e1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.252772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.266759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1212/2400] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:04.270917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.283723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494421c8-81ff-4c52-8972-52bebaea4fdc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.284808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1189/2401] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:04 2022] PUT /identity/v3/projects/4e35d6b41be14ec6805649ce6e05282d/users/876bcfc66f514622bc9ae5857145d627/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:04.289714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.290490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.290490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.331840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] MFA Rules not processed for user `876bcfc66f514622bc9ae5857145d627`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:04.333070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:04.364458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.365105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.365393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.365948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.366513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.368190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.381834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1213/2402] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:04.385718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.397208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e12251-ac36-47fc-89e9-ebdeef7662d7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.403475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.404165 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.404446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.404724 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] PATH_INFO: `/v3/projects/5f8ebf265ab245cc8a73075c7af988aa/users/fa5c5d173f454b4dae12c86f82d143ea/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.420721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ebf265ab245cc8a73075c7af988aa, user_id=fa5c5d173f454b4dae12c86f82d143ea, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.423650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c89427-5480-41b3-87e4-66da1020a023 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.428335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1190/2403] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:04.433023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.439465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1214/2404] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:04 2022] PUT /identity/v3/projects/5f8ebf265ab245cc8a73075c7af988aa/users/fa5c5d173f454b4dae12c86f82d143ea/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:04.446424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39bf0c-8f09-4e87-a657-3375a9a7a31d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.452420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.452928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.453558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.484155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] MFA Rules not processed for user `fa5c5d173f454b4dae12c86f82d143ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:04.485808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:04.509377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:04.534908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.535789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.536170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.536823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.537618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.540204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.567140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1215/2405] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:04.568623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.583346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33b68-5202-45b2-a519-e6883dfd9447 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.590740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.591632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.592101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.592495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.593432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.596757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.597213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1191/2406] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/projects => generated 382 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:04.600937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.644265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1216/2407] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/projects => generated 374 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:04.647793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.733473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff03e-4389-4b75-82c7-f533abbe0e2a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.734402 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:04.790270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9065-382f-4282-8475-4d38f10cbb47 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.796760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.798015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.798015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.798275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.798984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.802745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.849973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1217/2408] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:04.851369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.864111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604bd6-4773-4c21-bea6-28b2d5b24922 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.869207 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.869836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.870117 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.870388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.871094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.872723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.884524 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.885449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.885599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1218/2409] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:04.886040 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.886317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.887234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.888964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.890212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.903221 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef755ad-e47c-4e1c-b94a-2485cdf62934 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.910574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.911994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.912534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.913006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] PATH_INFO: `/v3/projects/1a9c4f5701a14847bca8993be069b274/users/aff5b8c3c82347a08ffe556225ed3933/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.917693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1192/2410] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:04 2022] POST /identity/v3/users => generated 298 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:04.921710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.932550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c4f5701a14847bca8993be069b274, user_id=aff5b8c3c82347a08ffe556225ed3933, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.935415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.935816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b3c1-0e75-436c-97d5-51cc50c3219a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:04.941133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:04.941972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:04.943186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:04.943503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:04.944852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:04.946210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:04.954444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1219/2411] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:04 2022] PUT /identity/v3/projects/1a9c4f5701a14847bca8993be069b274/users/aff5b8c3c82347a08ffe556225ed3933/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:04.958150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.963350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1193/2412] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:04.967756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:04.980734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15591-7937-4673-9209-999eb807a07e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.046195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe4f0-071f-46b3-a7f7-d9786318e3b2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.052051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.053219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.053797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.053946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:05.054542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.055281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.057054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.065895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.065895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.065895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.065895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] PATH_INFO: `/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8/users/8433445e164c464b9d1eabf2d6a2ce56/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.071477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1220/2413] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:04 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:05.075456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.086383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de32eeecc40d4de686b99a6b7c0ba8d8, user_id=8433445e164c464b9d1eabf2d6a2ce56, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.088678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878a58d-28eb-4820-989e-10aa02cbc3bc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.089290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.095748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.096745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.097306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.097608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] PATH_INFO: `/v3/projects/1a9c4f5701a14847bca8993be069b274/users/aff5b8c3c82347a08ffe556225ed3933/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.099745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c4f5701a14847bca8993be069b274, user_id=aff5b8c3c82347a08ffe556225ed3933, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.102416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5647c-1a03-409a-9e9a-07ef91155d61 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.111017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1194/2414] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:04 2022] PUT /identity/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8/users/8433445e164c464b9d1eabf2d6a2ce56/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:05.115461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.116223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1221/2415] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:05 2022] PUT /identity/v3/projects/1a9c4f5701a14847bca8993be069b274/users/aff5b8c3c82347a08ffe556225ed3933/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:05.128090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.128373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.128650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.165509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] MFA Rules not processed for user `aff5b8c3c82347a08ffe556225ed3933`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:05.166882 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:05.186905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed296c-d68b-4b4d-8a26-f7a4e4be9e95 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.233101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:05.243852 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1222/2416] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:05.256088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.256248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.256948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.257233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.257508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.257862 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:05.258851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.260494 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.273357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1195/2417] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:05 2022] GET /identity/v3/roles => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:05.284567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.296882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069500f-8b73-44ce-8ac1-5019535c6e12 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.302597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.303338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.303652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.303981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] PATH_INFO: `/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8/users/8433445e164c464b9d1eabf2d6a2ce56/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.306026 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de32eeecc40d4de686b99a6b7c0ba8d8, user_id=8433445e164c464b9d1eabf2d6a2ce56, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.308691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebf909-b950-412d-89e1-d6034568f765 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.326115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1196/2418] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:05 2022] PUT /identity/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8/users/8433445e164c464b9d1eabf2d6a2ce56/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:05.330906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.331351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.331653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.340780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a376-667f-4509-bc54-52711e9f6804 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.370878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] MFA Rules not processed for user `8433445e164c464b9d1eabf2d6a2ce56`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:05.372135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:05.414604 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.415282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.415596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.415871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.449754 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:05.467178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1197/2419] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:05.474378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.476035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:05.496528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36ea8-9b05-4672-bf8c-e38a66c7a2a8 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.498727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.500587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.500731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.501425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.501764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.502099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.511772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.511948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1223/2420] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:05.513343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.524131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1198/2421] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:05.644773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:05.653821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686f1f-887d-4e96-b567-81286b43132e service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:05.657926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:05.658635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:05.658990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:05.659341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:05.729084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:05.731181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6664c4-0e68-4b4f-95d4-8a6d9e09367f service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:05.740670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:05.744367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1224/2422] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:06.077395 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:06.231750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33523-ded9-44d3-b46e-62156c118d13 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:06.245009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:06.245915 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:06.246142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:06.246420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] PATH_INFO: `/v3/users/fa5c5d173f454b4dae12c86f82d143ea` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:06.254802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5c5d173f454b4dae12c86f82d143ea)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:06.260777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:06.350366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5c5d173f454b4dae12c86f82d143ea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.375161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5c5d173f454b4dae12c86f82d143ea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.376215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5c5d173f454b4dae12c86f82d143ea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.386233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5c5d173f454b4dae12c86f82d143ea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.432764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5c5d173f454b4dae12c86f82d143ea'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.443650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1199/2423] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:06 2022] DELETE /identity/v3/users/fa5c5d173f454b4dae12c86f82d143ea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:06.446820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:06.447334 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:06.447452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:06.474300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:06.478261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:06.559886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1225/2424] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:06.572231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:06.574389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:06.666121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79bd8-1705-4fa3-b309-f67bd76e100b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:06.670920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:06.671820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:06.672201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:06.672473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:06.684151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:06.685661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:06.699605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1200/2425] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:06.788587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:06.790576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:06.806577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45ae50-d1af-4763-b4c5-227348ec78b8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:06.812048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:06.812965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:06.813338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:06.813627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] PATH_INFO: `/v3/users/396a79cbb4e9494791422713c596bc0c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:06.814938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=396a79cbb4e9494791422713c596bc0c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:06.816959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:06.865846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396a79cbb4e9494791422713c596bc0c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.866506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396a79cbb4e9494791422713c596bc0c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.867115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396a79cbb4e9494791422713c596bc0c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.876123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396a79cbb4e9494791422713c596bc0c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.883806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396a79cbb4e9494791422713c596bc0c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:06.902598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1226/2426] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:06 2022] DELETE /identity/v3/users/396a79cbb4e9494791422713c596bc0c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:07.047532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.049270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.058615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:07.065415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608518e-0649-49b4-9b33-c20c5ad39bc2 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.093513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.095231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.142608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.143268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.143612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.143895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] PATH_INFO: `/v3/projects/5f8ebf265ab245cc8a73075c7af988aa` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.145076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8ebf265ab245cc8a73075c7af988aa)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.147053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.167690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3b5ac-144d-463a-8aa5-072a0219ee6e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.172642 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.173339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.173624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.173901 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] PATH_INFO: `/v3/projects/2ae12b8f8a7f40758ca0edaeea7022ab` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.175176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae12b8f8a7f40758ca0edaeea7022ab)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.177231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.194772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:07.197108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8ebf265ab245cc8a73075c7af988aa', 'request_id': 'req-ca3ffe63-a85c-400e-8a86-4e899cb4c421'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.204296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8ebf265ab245cc8a73075c7af988aa', 'request_id': 'req-ca3ffe63-a85c-400e-8a86-4e899cb4c421'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.211795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8ebf265ab245cc8a73075c7af988aa', 'request_id': 'req-ca3ffe63-a85c-400e-8a86-4e899cb4c421'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.226276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] The token cache is being invalidate because project 5f8ebf265ab245cc8a73075c7af988aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:07.226704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.227659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.229839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1201/2427] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:07 2022] DELETE /identity/v3/projects/5f8ebf265ab245cc8a73075c7af988aa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:07.235562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.238333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae12b8f8a7f40758ca0edaeea7022ab', 'request_id': 'req-78881923-8f81-49c4-af9d-f89954f8dd33'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.245188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae12b8f8a7f40758ca0edaeea7022ab', 'request_id': 'req-78881923-8f81-49c4-af9d-f89954f8dd33'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.248896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.252347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae12b8f8a7f40758ca0edaeea7022ab', 'request_id': 'req-78881923-8f81-49c4-af9d-f89954f8dd33'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.269076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] The token cache is being invalidate because project 2ae12b8f8a7f40758ca0edaeea7022ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:07.269457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.270180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-78881923-8f81-49c4-af9d-f89954f8dd33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.272519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1227/2428] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:07 2022] DELETE /identity/v3/projects/2ae12b8f8a7f40758ca0edaeea7022ab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:07.277428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f872cb-531f-41c2-b551-520bbda3fe5f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.277720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f872cb-531f-41c2-b551-520bbda3fe5f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.278004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f872cb-531f-41c2-b551-520bbda3fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.302451 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a6f872cb-531f-41c2-b551-520bbda3fe5f None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:07.303733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a6f872cb-531f-41c2-b551-520bbda3fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.329810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffe63-a85c-400e-8a86-4e899cb4c421 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.379744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:07.407116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.408092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.408548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.409278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] PATH_INFO: `/v3/users/aff5b8c3c82347a08ffe556225ed3933` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.410991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff5b8c3c82347a08ffe556225ed3933)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.413260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.414054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1228/2429] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:07.423116 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.424513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.424513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.446924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:07.449757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.463380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1229/2430] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:07.470146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.489487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2acc-5fef-4b73-9758-01b3f11e86bf None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.495543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.496186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.497715 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.497921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.500625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:07.501227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.503690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.505744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff5b8c3c82347a08ffe556225ed3933'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.519011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff5b8c3c82347a08ffe556225ed3933'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.519011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff5b8c3c82347a08ffe556225ed3933'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.521357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1230/2431] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:07.526251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.533265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff5b8c3c82347a08ffe556225ed3933'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.541103 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc2db-734f-4e78-9c68-e8cd09e2aace admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.547351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff5b8c3c82347a08ffe556225ed3933'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:07.547829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.548727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.549458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.549949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.551169 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.553293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.554676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1202/2432] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:07 2022] DELETE /identity/v3/users/aff5b8c3c82347a08ffe556225ed3933 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:07.584386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1231/2433] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:07 2022] POST /identity/v3/projects => generated 382 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:07.588603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.590044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.668830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7c2dd-16ad-4dd6-99e1-dde8589773ee admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.740996 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.741825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.742208 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.742730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.743453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.745452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.758729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:07.776638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.777316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1203/2434] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:07 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:07.787609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868de94-4539-4829-9c6b-d80e4e1373f2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.792968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.795991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.797194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.797549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.798738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.800532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.814020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1232/2435] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:07 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:07.819032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.836198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80e02-d881-4562-a287-533922d907f7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.841425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.842944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.843320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.844060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.844585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.846303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acd2b1-f28a-49e8-a126-2b7d8a9e0ec2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.860272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1204/2436] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:07 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:07.861808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.872549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997403e-4979-4a20-8a92-eae8870d1955 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:07.877842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:07.878643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.878993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.879696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] PATH_INFO: `/v3/projects/a1542531015b4e929660f24d597e4ef2/users/cc977df8e1db464681be4b659b17f220/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.896190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1542531015b4e929660f24d597e4ef2, user_id=cc977df8e1db464681be4b659b17f220, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:07.899746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:07.919431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1233/2437] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:07 2022] PUT /identity/v3/projects/a1542531015b4e929660f24d597e4ef2/users/cc977df8e1db464681be4b659b17f220/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:07.932068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:07.932359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:07.932640 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:07.937176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:07.939518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.966811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] MFA Rules not processed for user `cc977df8e1db464681be4b659b17f220`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:07.968836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:07.981132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.016884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222ba-772d-43ce-b3e1-9f801e28e093 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.021894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.022683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.023039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.023460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] PATH_INFO: `/v3/projects/1a9c4f5701a14847bca8993be069b274` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.024705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9c4f5701a14847bca8993be069b274)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.027151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.036817 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1205/2438] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:08.041375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.051852 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e6f1-8750-42e7-84a6-e9b8623e5486 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.057886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.058513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.058799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.059080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.060307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.062238 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.073875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9c4f5701a14847bca8993be069b274', 'request_id': 'req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.081098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9c4f5701a14847bca8993be069b274', 'request_id': 'req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.087202 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9c4f5701a14847bca8993be069b274', 'request_id': 'req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.092043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1206/2439] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/projects => generated 378 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:08.096441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.103954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] The token cache is being invalidate because project 1a9c4f5701a14847bca8993be069b274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:08.104241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.104867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-012a5fa0-76ad-4f08-a762-5a06b83f6ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.106428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1234/2440] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:07 2022] DELETE /identity/v3/projects/1a9c4f5701a14847bca8993be069b274 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:08.111050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40807-a71f-430d-8d9b-87c2d2e797c1 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.111331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40807-a71f-430d-8d9b-87c2d2e797c1 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.111636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40807-a71f-430d-8d9b-87c2d2e797c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.132765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b6d40807-a71f-430d-8d9b-87c2d2e797c1 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:08.133984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6d40807-a71f-430d-8d9b-87c2d2e797c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.162965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5655a-7776-4e2d-b794-40f5cca6fa23 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.168390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.169019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.169308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.169581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.170245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.172435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.195002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1207/2441] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:08.202598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1235/2442] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:08.208071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.213998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.215467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.215931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.220375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.237959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92d980-6872-472b-b688-969915ed1a44 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.243583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.244438 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.244897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.245331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.246216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.248063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.248653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:08.254917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.267549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1208/2443] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:08.269301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.272111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1236/2444] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:08.280767 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.296419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa45-439c-4ff6-8240-8f2e62a24367 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.297138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b41925-d919-4acc-a78c-192eb9a23ade None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.304544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.305254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.305544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.306349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] PATH_INFO: `/v3/projects/2909d14d7ac54f8485e121b2b63905f8/users/9b09368bc76840f8a5f4dd96fafc23e4/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.320823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.321793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.322077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.322353 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.323256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:08.323616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.325447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.326224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2909d14d7ac54f8485e121b2b63905f8, user_id=9b09368bc76840f8a5f4dd96fafc23e4, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.330243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.338888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1237/2445] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:08.343241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.347774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1209/2446] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:08 2022] PUT /identity/v3/projects/2909d14d7ac54f8485e121b2b63905f8/users/9b09368bc76840f8a5f4dd96fafc23e4/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:08.351525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.354308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf497b-d466-44e2-ac22-90184b794d0a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.380265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.416956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.456223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.456864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.457138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.457465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.458671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d183f8-dcea-47f1-835a-02feaad18cc5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.459321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.461320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.464969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.465846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.466235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.466616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.467453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.469538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.482010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1210/2447] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:08.486768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.497287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea555-4b19-4d45-a019-344e538d8cb4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.502778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.504199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1238/2448] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/projects => generated 378 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:08.504496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.504819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.505173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] PATH_INFO: `/v3/projects/2909d14d7ac54f8485e121b2b63905f8/users/9b09368bc76840f8a5f4dd96fafc23e4/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.507995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2909d14d7ac54f8485e121b2b63905f8, user_id=9b09368bc76840f8a5f4dd96fafc23e4, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.508148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.513934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6348e-b05e-4c1a-a3e1-743d320c5dd2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.532303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1211/2449] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:08 2022] PUT /identity/v3/projects/2909d14d7ac54f8485e121b2b63905f8/users/9b09368bc76840f8a5f4dd96fafc23e4/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:08.543095 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.543405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.543776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.609882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] MFA Rules not processed for user `9b09368bc76840f8a5f4dd96fafc23e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:08.610920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1a41-5970-4243-9a67-03da31d9dd3e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.611189 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.685752 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.687565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.688067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.688523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.689387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.691650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.705502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1212/2450] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:08.706396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.708961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.726629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8bb1-a59b-4f87-8512-65a3917f605d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.727912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1239/2451] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:08.729694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.731662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.738099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.738885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.739280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.739969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] PATH_INFO: `/v3/users/876bcfc66f514622bc9ae5857145d627` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.740972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876bcfc66f514622bc9ae5857145d627)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.743002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.796351 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893cc92-5226-41c1-abbe-8319a6adadf7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.801418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.802149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.802433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.802783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.811885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876bcfc66f514622bc9ae5857145d627'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.815427 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.817196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.821844 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876bcfc66f514622bc9ae5857145d627'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.822660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876bcfc66f514622bc9ae5857145d627'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.831822 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876bcfc66f514622bc9ae5857145d627'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.832144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1240/2452] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:08.832699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.839675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.851335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.852310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-90f56bb2-e96d-496e-99d8-3fef3a3d67a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876bcfc66f514622bc9ae5857145d627'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:08.857376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1bcc8-0092-4b4a-af21-b91bcf0b42c7 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.861295 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1213/2453] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:08 2022] DELETE /identity/v3/users/876bcfc66f514622bc9ae5857145d627 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:08.866198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.866551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.866727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.866958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.867591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.868216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.868841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.869803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.873623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:08.886044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1241/2454] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:08.891702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.891914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:08.893254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.894060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.912939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a4c5-be15-4531-9af6-50b038053f1e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:08.974896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1214/2455] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:08.975739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:08.977387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:08.994408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:08.995126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:08.995495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:08.995780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:08.996495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:08.998123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.012987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1242/2456] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:09.012987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.012987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.063490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362dc4-d3eb-4170-8438-13e61ac9cf4b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.067914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.068682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.069063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.069418 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.071638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.082909 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9a7a-4cf2-4cb3-9302-42e21c5bf404 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.087545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.088346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.088728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.089107 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.099953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.101755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.113077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1243/2457] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:09 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:09.114042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.124686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990c6a-1df2-473d-ba65-184874ab41ec service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.130160 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.131066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.131599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.132059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] PATH_INFO: `/v3/projects/c1411093c2a44d83ae71f33284f183aa/users/3e73e96b5d9844f4af9209d279498158/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.164349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.166761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8d2af-c6ff-477d-ac23-49a496a81aa7 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.172618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1411093c2a44d83ae71f33284f183aa, user_id=3e73e96b5d9844f4af9209d279498158, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.176631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.181806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1215/2458] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:09.208249 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1244/2459] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:09 2022] PUT /identity/v3/projects/c1411093c2a44d83ae71f33284f183aa/users/3e73e96b5d9844f4af9209d279498158/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:09.220591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.220887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.221170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.264138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] MFA Rules not processed for user `3e73e96b5d9844f4af9209d279498158`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:09.266538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.315239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:09.380544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.380684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1216/2460] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:09.465212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5061ab-2221-4a8f-b49f-df9f50a625c7 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.471392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.471940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.472274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.472786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.473413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.475707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.488042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:09.513720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1245/2461] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:09 2022] POST /identity/v3/projects => generated 378 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:09.518137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.524457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.529151 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.533113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a77e6-9f9f-4ddf-8ee3-ed5aa3bbef26 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.620693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004c71-d454-4e70-806e-034f86021727 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.626957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.627787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.627929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.628287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.628419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.628683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] PATH_INFO: `/v3/projects/4e35d6b41be14ec6805649ce6e05282d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.628789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.629063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.629676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.630171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e35d6b41be14ec6805649ce6e05282d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.631737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.633866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.659531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1217/2462] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:09 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:09.662061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.675480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe345-13d2-41c5-952c-fc2173187abf admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.687389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e35d6b41be14ec6805649ce6e05282d', 'request_id': 'req-981f6c60-fc39-4741-8653-7a31e9883d36'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.695197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e35d6b41be14ec6805649ce6e05282d', 'request_id': 'req-981f6c60-fc39-4741-8653-7a31e9883d36'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.705924 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e35d6b41be14ec6805649ce6e05282d', 'request_id': 'req-981f6c60-fc39-4741-8653-7a31e9883d36'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.724089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] The token cache is being invalidate because project 4e35d6b41be14ec6805649ce6e05282d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:09.724872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.725558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.727900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1246/2463] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:09 2022] DELETE /identity/v3/projects/4e35d6b41be14ec6805649ce6e05282d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:09.732726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.735286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.751473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.752222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.752564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.752898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.753983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.755465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.770648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1218/2464] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:09 2022] GET /identity/v3/roles => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:09.771766 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.773684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:09.788050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526a7-e7d6-452c-a946-4d52a5ecd87f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.794018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.801075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.801380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.801674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] PATH_INFO: `/v3/projects/ec0649940bff4e938a97d0b770b6e62e/users/8f88bacbb78e47099f812b22c6a115f5/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.813335 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f6c60-fc39-4741-8653-7a31e9883d36 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.819086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.819792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.820078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.820282 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0649940bff4e938a97d0b770b6e62e, user_id=8f88bacbb78e47099f812b22c6a115f5, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.820408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] PATH_INFO: `/v3/users/8433445e164c464b9d1eabf2d6a2ce56` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.821613 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8433445e164c464b9d1eabf2d6a2ce56)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.823657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.823793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.838660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1219/2465] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:09 2022] PUT /identity/v3/projects/ec0649940bff4e938a97d0b770b6e62e/users/8f88bacbb78e47099f812b22c6a115f5/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:09.842398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.850435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:09.881053 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8433445e164c464b9d1eabf2d6a2ce56'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.882162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8433445e164c464b9d1eabf2d6a2ce56'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.882800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8433445e164c464b9d1eabf2d6a2ce56'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.885891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:09.892657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8433445e164c464b9d1eabf2d6a2ce56'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.902690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8433445e164c464b9d1eabf2d6a2ce56'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:09.918260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7a072-7126-4baf-a173-1624773f84cd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:09.924894 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1247/2466] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:09 2022] DELETE /identity/v3/users/8433445e164c464b9d1eabf2d6a2ce56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:09.925417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:09.926508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:09.926985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:09.927517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:09.928706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:09.930225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd58211-562b-43d0-80e3-1d87739bbed3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:09.943408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1220/2467] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:09 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:09.945728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:09.947844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.025106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4dd1-b24d-4b91-b907-2bd347a8e16c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.030432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.031311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.031705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.032101 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] PATH_INFO: `/v3/projects/ec0649940bff4e938a97d0b770b6e62e/users/8f88bacbb78e47099f812b22c6a115f5/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.034358 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0649940bff4e938a97d0b770b6e62e, user_id=8f88bacbb78e47099f812b22c6a115f5, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.037286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.049219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1248/2468] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:09 2022] PUT /identity/v3/projects/ec0649940bff4e938a97d0b770b6e62e/users/8f88bacbb78e47099f812b22c6a115f5/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:10.060736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.061034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.061319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.090485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] MFA Rules not processed for user `8f88bacbb78e47099f812b22c6a115f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:10.091757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.171897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1221/2469] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:10.183445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:10.186017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.251389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:10.252775 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.259657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d749ec-2612-442f-9a39-ebcbdd00398b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.264425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.265069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.265403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.265792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.268173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.324408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:10.340436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.342243 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59aacc-30d8-40ca-a0a5-8901bd79ceee service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.348301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010c964-ec4e-4fc6-8aa5-bde23904bf0c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.354975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.355707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.355964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.356244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] PATH_INFO: `/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.357475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de32eeecc40d4de686b99a6b7c0ba8d8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.359864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.363517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1249/2470] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:10.434612 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de32eeecc40d4de686b99a6b7c0ba8d8', 'request_id': 'req-50a7e7b3-dc81-4512-8879-61b430b86784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:10.451445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de32eeecc40d4de686b99a6b7c0ba8d8', 'request_id': 'req-50a7e7b3-dc81-4512-8879-61b430b86784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:10.457030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:10.469581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de32eeecc40d4de686b99a6b7c0ba8d8', 'request_id': 'req-50a7e7b3-dc81-4512-8879-61b430b86784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:10.494357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] The token cache is being invalidate because project de32eeecc40d4de686b99a6b7c0ba8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:10.494653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:10.495329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-50a7e7b3-dc81-4512-8879-61b430b86784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:10.500551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1222/2471] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:10 2022] DELETE /identity/v3/projects/de32eeecc40d4de686b99a6b7c0ba8d8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:10.502061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.502545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.502652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.527633 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:10.531199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.642532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1250/2472] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:10.653434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.653758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.654131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.677261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:10.679275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:10.692287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1223/2473] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:10.696957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:10.715679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a702-341a-4e48-aef9-f5331e748ea6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.724721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.725586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.726138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.726138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.726906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:10.727223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.729224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.745366 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1251/2474] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:10.749867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:10.761630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06fb57-70f7-4d5f-871b-3b13f33177fc None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.774136 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.774808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.775408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.776022 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.776713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.780558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.835286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1224/2475] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:10 2022] POST /identity/v3/projects => generated 376 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:10.838890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:10.852879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9c78-d27f-4fc7-b26b-4f91467eabcd admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:10.952218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:10.953138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:10.953536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:10.954073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:10.954907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:10.956981 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:10.987382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1252/2476] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:10 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:10.992405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.003855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af222-ed9c-47a6-a904-507b5aa5eb59 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.009512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.010385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.010682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.010961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.012890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.013574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.026345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1225/2477] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:10 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:11.032312 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.043878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56944b-4131-4408-a0ca-4678a7d83336 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.050460 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.051108 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.051415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.051684 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.052392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.054157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae1b37-af0f-418e-a255-d2c870cb4059 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.067368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1253/2478] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:11 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:11.072702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.085910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b34ed-e03c-457c-99ec-82180ec5b3f8 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.091780 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.092709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.092835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.093036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] PATH_INFO: `/v3/projects/bf07a80a048c442f9a41cac6212132f9/users/a2e5b3ef334549638fb7644790b7ef4c/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.113193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf07a80a048c442f9a41cac6212132f9, user_id=a2e5b3ef334549638fb7644790b7ef4c, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.116622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.134098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1226/2479] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:11 2022] PUT /identity/v3/projects/bf07a80a048c442f9a41cac6212132f9/users/a2e5b3ef334549638fb7644790b7ef4c/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:11.145973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.146258 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.146538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.177250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] MFA Rules not processed for user `a2e5b3ef334549638fb7644790b7ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:11.178468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:11.228090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:11.251252 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1254/2480] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:11.256547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.341085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc762331-2036-46c8-89e9-ca51280a93a8 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.346709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.347284 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.347589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.347872 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.348562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.350648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.385715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1227/2481] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:11 2022] POST /identity/v3/projects => generated 374 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:11.392885 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.405236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51dd4-2990-409e-8045-5b2c676e6fa9 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.473226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.474110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.474474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.474825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.475656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.477757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.506939 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1255/2482] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:11 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:11.511221 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.527121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273582-73d2-48c2-9f0e-7a9ad90730cd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.533935 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.534607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.535045 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.535327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.536114 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.538859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.551206 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1228/2483] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:11 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:11.555454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.566641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6633d-e145-47eb-8efd-8e3a9b6f65c8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.572376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.573209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.574007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.574007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] PATH_INFO: `/v3/projects/69b886a884d94827a2bafc48938d889c/users/304551cf584a4dacb3ac81fbab01b50d/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.593280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b886a884d94827a2bafc48938d889c, user_id=304551cf584a4dacb3ac81fbab01b50d, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.596295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.614219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1256/2484] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:11 2022] PUT /identity/v3/projects/69b886a884d94827a2bafc48938d889c/users/304551cf584a4dacb3ac81fbab01b50d/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:11.618604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.631583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f64e2e-bc27-493f-8c15-93e59031d619 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.696510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:11.709591 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.710646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.711205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.711816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.712681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.714470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545848c5-8d9d-4290-9863-e419ccce7652 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.726382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1229/2485] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:11 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:11.730296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:11.746531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159d17a-baa9-4f9c-8dc3-fb84c946e6e5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:11.764138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:11.764138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.764138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.764138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] PATH_INFO: `/v3/projects/69b886a884d94827a2bafc48938d889c/users/304551cf584a4dacb3ac81fbab01b50d/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.764643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b886a884d94827a2bafc48938d889c, user_id=304551cf584a4dacb3ac81fbab01b50d, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:11.767187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:11.784111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1257/2486] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:11 2022] PUT /identity/v3/projects/69b886a884d94827a2bafc48938d889c/users/304551cf584a4dacb3ac81fbab01b50d/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:11.794181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:11.794468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:11.794749 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:11.849968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] MFA Rules not processed for user `304551cf584a4dacb3ac81fbab01b50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:11.852193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:12.009930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1230/2487] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:12.021749 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:12.024200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:12.108739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482847-5c99-49d0-86fa-2581e620bd17 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:12.113559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:12.114226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:12.114490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:12.114770 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:12.174620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:12.184943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:12.186650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:12.197622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1258/2488] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:15.389159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:15.400162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9587-5dc0-4aa7-84d5-8b0c2b96f195 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:15.405150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:15.405788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:15.406053 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:15.406361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:15.408520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:15.477191 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:15.478644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcedc3f-9b3d-4d0b-9554-47fd875fa5a0 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:15.489730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1231/2489] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:22.192822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:22.289340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:22.354976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa183-fc4b-4576-9080-4ba0a37e0046 service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:22.359685 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:22.360341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:22.360626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:22.360902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] PATH_INFO: `/v3/users/a2e5b3ef334549638fb7644790b7ef4c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:22.362111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e5b3ef334549638fb7644790b7ef4c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:22.364092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:22.417638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e5b3ef334549638fb7644790b7ef4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:22.418353 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e5b3ef334549638fb7644790b7ef4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:22.418953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e5b3ef334549638fb7644790b7ef4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:22.428181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e5b3ef334549638fb7644790b7ef4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:22.436288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e5b3ef334549638fb7644790b7ef4c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:22.454616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1259/2490] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:22 2022] DELETE /identity/v3/users/a2e5b3ef334549638fb7644790b7ef4c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:22.459250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:22.459787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:22.459880 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:22.484466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:22.485850 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:22.552435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1232/2491] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:22.562513 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:22.564077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:22.641332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b86-c6a5-4b0c-8355-6345dfbc0c3a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:22.645199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:22.645953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:22.646299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:22.646648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:22.659140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:22.660648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:22.675453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1260/2492] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:23.040797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:23.042575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:23.054803 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1605f-97b4-47f9-94e0-cf440d3fa8da None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:23.060296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:23.060986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.061228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.061508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] PATH_INFO: `/v3/projects/bf07a80a048c442f9a41cac6212132f9` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.062832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf07a80a048c442f9a41cac6212132f9)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:23.064916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:23.076313 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:23.123710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf07a80a048c442f9a41cac6212132f9', 'request_id': 'req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.130637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf07a80a048c442f9a41cac6212132f9', 'request_id': 'req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.136907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf07a80a048c442f9a41cac6212132f9', 'request_id': 'req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.151703 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] The token cache is being invalidate because project bf07a80a048c442f9a41cac6212132f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:23.151983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.152621 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.154278 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1233/2493] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:23 2022] DELETE /identity/v3/projects/bf07a80a048c442f9a41cac6212132f9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:23.159486 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:23.170039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7423-a7b6-4799-b3c3-94e5474beb4d service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:23.188646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:23.234099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:23.234808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.235218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.235548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] PATH_INFO: `/v3/users/304551cf584a4dacb3ac81fbab01b50d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.236764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=304551cf584a4dacb3ac81fbab01b50d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:23.238725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:23.307890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304551cf584a4dacb3ac81fbab01b50d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.308979 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304551cf584a4dacb3ac81fbab01b50d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.309900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304551cf584a4dacb3ac81fbab01b50d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.320385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304551cf584a4dacb3ac81fbab01b50d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.339040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-e855bbbd-2b0e-4745-9bd4-d07f84eba7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304551cf584a4dacb3ac81fbab01b50d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.377522 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1261/2494] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:23 2022] DELETE /identity/v3/users/304551cf584a4dacb3ac81fbab01b50d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:23.679824 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:23.681510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:23.702527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbcb74-2afc-47e1-a0b9-e89da3715a6c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:23.780791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:23.780791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.780791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.780791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] PATH_INFO: `/v3/projects/69b886a884d94827a2bafc48938d889c` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.781367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b886a884d94827a2bafc48938d889c)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:23.782985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:23.837882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b886a884d94827a2bafc48938d889c', 'request_id': 'req-68949f86-60a6-43cb-97b0-f962534505b6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.844624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b886a884d94827a2bafc48938d889c', 'request_id': 'req-68949f86-60a6-43cb-97b0-f962534505b6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.850492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b886a884d94827a2bafc48938d889c', 'request_id': 'req-68949f86-60a6-43cb-97b0-f962534505b6'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.864762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] The token cache is being invalidate because project 69b886a884d94827a2bafc48938d889c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:23.865054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.865687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:23.867246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1234/2495] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:23 2022] DELETE /identity/v3/projects/69b886a884d94827a2bafc48938d889c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:23.872739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca185-338e-411e-ad05-3fcd010a3703 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.873032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca185-338e-411e-ad05-3fcd010a3703 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.873307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca185-338e-411e-ad05-3fcd010a3703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.883706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:23.885096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:23.893632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a99ca185-338e-411e-ad05-3fcd010a3703 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:23.894793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a99ca185-338e-411e-ad05-3fcd010a3703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:23.913783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:23.953487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68949f86-60a6-43cb-97b0-f962534505b6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:23.956399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1262/2496] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:23.959639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:23.960505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.960950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.961394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] PATH_INFO: `/v3/users/cc977df8e1db464681be4b659b17f220` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.962820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc977df8e1db464681be4b659b17f220)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:23.964266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:23.964555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:23.964832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:23.965654 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:23.985086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:23.986293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:23.994600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1263/2497] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:23.999071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.009099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe237649-4683-448f-93a2-74f2a77345f7 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.014813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.015478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.015769 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.016173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.016864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:24.017173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.018866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.020171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc977df8e1db464681be4b659b17f220'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.028433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc977df8e1db464681be4b659b17f220'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.029293 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc977df8e1db464681be4b659b17f220'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.031928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1264/2498] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:24.036628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.037968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc977df8e1db464681be4b659b17f220'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.046822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf648-32f7-4b97-b4fb-0cbb4b74de24 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.051348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-690adc83-18e3-4dfa-9ccf-56fcb328daf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc977df8e1db464681be4b659b17f220'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.051501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.052021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.052303 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.052580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.053239 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.055131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.060471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1235/2499] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:23 2022] DELETE /identity/v3/users/cc977df8e1db464681be4b659b17f220 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:24.062011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.062649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.062649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.079978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:24.082908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:24.084149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.089044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1265/2500] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:24 2022] POST /identity/v3/projects => generated 368 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:24.092223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.095707 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.149488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1236/2501] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:24.159684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.161103 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.163828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17d8e-1f76-4f99-a598-b2d06f118184 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.168473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.169099 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.169380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.169655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.170341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.172397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.197405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1266/2502] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:24 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:24.201337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.212458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d32f-911f-4598-92ce-eeceab5b74a5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.217742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:24.219492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.220319 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.220729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.220993 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.221734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.223381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.230737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711595-d634-49a2-a7a8-25aca39036f2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.235001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1267/2503] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:24 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:24.235532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.236102 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.236390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.236667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.238853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.246422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.248011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.248265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a815af-1254-4187-a2e9-3e3e3dec2696 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.253016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.253614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.253895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.254172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.254861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.256510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60315f-4dd1-49af-90c4-89d4f5f22eb8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.258205 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1237/2504] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:24.268857 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1268/2505] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:24 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:24.272974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.283693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d53223-8f12-4a6c-812e-ae819dfe9e6e service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.288575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.289251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.289530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.289800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] PATH_INFO: `/v3/projects/f73c735d92304329b9aab045d0f77f03/users/e6460857026145b7aacaa00e97f20471/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.305805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73c735d92304329b9aab045d0f77f03, user_id=e6460857026145b7aacaa00e97f20471, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.308517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.325132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1238/2506] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:24 2022] PUT /identity/v3/projects/f73c735d92304329b9aab045d0f77f03/users/e6460857026145b7aacaa00e97f20471/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:24.393943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.394381 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.394665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.428530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] MFA Rules not processed for user `e6460857026145b7aacaa00e97f20471`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:24.429821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.499457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1269/2507] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:24.512711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.517312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.576186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.577710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:24.616323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea5ee-10d8-4e18-9566-4e52df0e8efa admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.620325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.621540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.622013 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.622554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.638310 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.640267 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.651507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1239/2508] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:24.688759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:24.695545 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758163dd-553c-42f1-8c09-d72bcb6685f6 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.701970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.702821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.703196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.703614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] PATH_INFO: `/v3/projects/a1542531015b4e929660f24d597e4ef2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.705001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1542531015b4e929660f24d597e4ef2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.707067 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.760376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1542531015b4e929660f24d597e4ef2', 'request_id': 'req-14797691-275f-4fc7-9fff-2ce3e45008f0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.767557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1542531015b4e929660f24d597e4ef2', 'request_id': 'req-14797691-275f-4fc7-9fff-2ce3e45008f0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.773385 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1542531015b4e929660f24d597e4ef2', 'request_id': 'req-14797691-275f-4fc7-9fff-2ce3e45008f0'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.787330 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] The token cache is being invalidate because project a1542531015b4e929660f24d597e4ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:24.787655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.788311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.791426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1270/2509] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:24 2022] DELETE /identity/v3/projects/a1542531015b4e929660f24d597e4ef2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:24.794050 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:24.806232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59ae8-69c7-43d5-80af-1f7c36d7f2b4 service glance] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:24.868962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:24.869620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:24.869921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:24.870197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] PATH_INFO: `/v3/users/9b09368bc76840f8a5f4dd96fafc23e4` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:24.871422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b09368bc76840f8a5f4dd96fafc23e4)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:24.873358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:24.923001 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b09368bc76840f8a5f4dd96fafc23e4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.934708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b09368bc76840f8a5f4dd96fafc23e4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.935465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b09368bc76840f8a5f4dd96fafc23e4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.944665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b09368bc76840f8a5f4dd96fafc23e4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.949776 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:24.964030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f5cc4e3f-88f4-42d2-b64c-4f32eb45f816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b09368bc76840f8a5f4dd96fafc23e4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:24.973344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1240/2510] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:24 2022] DELETE /identity/v3/users/9b09368bc76840f8a5f4dd96fafc23e4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:25.264348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.265921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:25.281943 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14797691-275f-4fc7-9fff-2ce3e45008f0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.343378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.344046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.344331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.344615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] PATH_INFO: `/v3/projects/2909d14d7ac54f8485e121b2b63905f8` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.345813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2909d14d7ac54f8485e121b2b63905f8)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.347805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.401478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2909d14d7ac54f8485e121b2b63905f8', 'request_id': 'req-49c10841-1127-4a65-b5c0-369b29777fb6'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:25.409374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2909d14d7ac54f8485e121b2b63905f8', 'request_id': 'req-49c10841-1127-4a65-b5c0-369b29777fb6'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:25.415940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2909d14d7ac54f8485e121b2b63905f8', 'request_id': 'req-49c10841-1127-4a65-b5c0-369b29777fb6'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:25.432928 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] The token cache is being invalidate because project 2909d14d7ac54f8485e121b2b63905f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:25.433306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:25.434325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-49c10841-1127-4a65-b5c0-369b29777fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:25.436872 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1271/2511] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:25 2022] DELETE /identity/v3/projects/2909d14d7ac54f8485e121b2b63905f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:25.442071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.442375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.442684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.465449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:25.466642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:25.533923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1241/2512] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:25.543102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.543388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.543705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.564235 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:25.565438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:25.574084 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1272/2513] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:25.579904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.593351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f95ae-ae8a-4670-be88-213772303844 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.605202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.606273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.606742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.607199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.608410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:25.608917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.610550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.627314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1242/2514] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:25.632383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.647662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5aa76-b23a-4b24-b419-dc99cfb37fb3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.653518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.654199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.654485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.654759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.655574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.657863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.667565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:25.689571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1273/2515] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:25 2022] POST /identity/v3/projects => generated 366 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:25.694032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.704937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa203-7efc-4bf7-8221-e0245c446bfd admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.764181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.765034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.765220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.765499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.766247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.768234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.790842 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1243/2516] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:25 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:25.794994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.806191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcfe9b-0c84-421f-96a4-6120b7e3dcc6 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.812206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.812838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.813212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.813493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.814204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.815858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.827425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1274/2517] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:25 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:25.831839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.842352 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14113552-2c16-4e27-a24b-f94056694fe1 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.847686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.848344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.848617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.848897 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.849634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.851243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32df60-70d9-4b06-987a-29e4da4b193e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.862555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1244/2518] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:25.866818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:25.877764 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52590647-25c7-4ae8-8db3-3058f21c27c8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:25.885957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:25.886938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.887324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.887700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] PATH_INFO: `/v3/projects/64b813d542a84c27ad82d33e1e58b97d/users/c22b1cd0cd6e44e2824818de9a35b14b/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.904815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b813d542a84c27ad82d33e1e58b97d, user_id=c22b1cd0cd6e44e2824818de9a35b14b, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:25.907524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:25.922738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1275/2519] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:25 2022] PUT /identity/v3/projects/64b813d542a84c27ad82d33e1e58b97d/users/c22b1cd0cd6e44e2824818de9a35b14b/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:25.933856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:25.934151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:25.934430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:25.965588 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] MFA Rules not processed for user `c22b1cd0cd6e44e2824818de9a35b14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:25.967062 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:26.010177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:26.039677 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1245/2520] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:26.044818 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.110580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce50d-aeb9-4917-9c73-2980ca840d16 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.116260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.116875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.117154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.117443 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.118096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.120052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.148530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1276/2521] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:26 2022] POST /identity/v3/projects => generated 366 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:26.153408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.165164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42d17c-e319-4f99-b599-93ede437090e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.229646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.230275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.230574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.230830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.231525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.233496 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.255312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1246/2522] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:26 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:26.261256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.272976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9783-5ca2-4e3d-9095-57888be3ff6e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.279179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.280170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.280602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.280884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.281666 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.283286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.294316 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1277/2523] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:26.298922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.309945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b38a-8f39-4d13-aff9-cfdb73629dc6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.315138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.315853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.316140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.316416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] PATH_INFO: `/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c/users/bcbe77d895fb48268589233ed218a973/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.334786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb2eac5b9ad471d82ee120b951d5a2c, user_id=bcbe77d895fb48268589233ed218a973, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.339108 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.356383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1247/2524] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:26 2022] PUT /identity/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c/users/bcbe77d895fb48268589233ed218a973/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:26.362044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.372760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0789-9395-4402-a46b-2aa4f23f3edc admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.440419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.441089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.441368 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.441636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.442352 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.443992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03dd5f-b794-46f7-b5fc-9c327880b11f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.454182 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1278/2525] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:26 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:26.458547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.469795 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6abf8b-f280-422b-b4bb-d6618d58415f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.475334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.476175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.476462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.476741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] PATH_INFO: `/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c/users/bcbe77d895fb48268589233ed218a973/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.478809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb2eac5b9ad471d82ee120b951d5a2c, user_id=bcbe77d895fb48268589233ed218a973, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.481500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.493058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1248/2526] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:26 2022] PUT /identity/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c/users/bcbe77d895fb48268589233ed218a973/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:26.503948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.504241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.504550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.539587 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] MFA Rules not processed for user `bcbe77d895fb48268589233ed218a973`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:26.541431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:26.555374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:26.616960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1279/2527] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:26.629288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:26.632572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:26.704196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edae43-1630-4eda-bd08-2c0975f83587 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:26.710558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:26.711594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:26.712034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:26.712482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:26.728085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:26.730605 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5f64-2d2e-4bc6-94e8-023974ae5273 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:26.742969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1249/2528] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:27.207048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:27.272962 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac580-f13a-407e-9e4f-e49c8aa69f6f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:27.277967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:27.278616 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:27.278891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:27.279162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] PATH_INFO: `/v3/users/c22b1cd0cd6e44e2824818de9a35b14b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:27.280389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22b1cd0cd6e44e2824818de9a35b14b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:27.282495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:27.342413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22b1cd0cd6e44e2824818de9a35b14b'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:27.343027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22b1cd0cd6e44e2824818de9a35b14b'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:27.343823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22b1cd0cd6e44e2824818de9a35b14b'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:27.357142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22b1cd0cd6e44e2824818de9a35b14b'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:27.365475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22b1cd0cd6e44e2824818de9a35b14b'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:27.384609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1280/2529] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:27 2022] DELETE /identity/v3/users/c22b1cd0cd6e44e2824818de9a35b14b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:27.390763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:27.391276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:27.391276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:27.411384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:27.412618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:27.445567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:27.476663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1250/2530] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:27.486490 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:27.488222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:27.523507 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:27.562071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2681-a5af-4c84-afdc-6ddede8cd4ca admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:27.566418 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:27.567048 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:27.567325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:27.567634 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:27.577896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:27.579331 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:27.589318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1281/2531] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:27 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:27.927445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:27.930349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:27.950748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0d7c8-3afc-468e-b7d8-c2029604562d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:27.957762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:27.974150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:27.974150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:27.974150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] PATH_INFO: `/v3/projects/64b813d542a84c27ad82d33e1e58b97d` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:27.974150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b813d542a84c27ad82d33e1e58b97d)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:27.977520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:28.003164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:28.013856 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ba75-ad2a-47ee-ba62-fe494534b5be service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:28.018069 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:28.019417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:28.019417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:28.019417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:28.022049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:28.041619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:28.043071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:28.047153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b813d542a84c27ad82d33e1e58b97d', 'request_id': 'req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.054454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1282/2532] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:28 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:28.055773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b813d542a84c27ad82d33e1e58b97d', 'request_id': 'req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.066003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b813d542a84c27ad82d33e1e58b97d', 'request_id': 'req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.084564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] The token cache is being invalidate because project 64b813d542a84c27ad82d33e1e58b97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:28.084957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.085684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.087279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1251/2533] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:27 2022] DELETE /identity/v3/projects/64b813d542a84c27ad82d33e1e58b97d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:28.091501 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:28.101987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b384-6419-440a-8c78-d25002daab00 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:28.179033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:28.179706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:28.179990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:28.180272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] PATH_INFO: `/v3/users/bcbe77d895fb48268589233ed218a973` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:28.181565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbe77d895fb48268589233ed218a973)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:28.183543 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:28.243831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbe77d895fb48268589233ed218a973'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.244636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbe77d895fb48268589233ed218a973'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.245313 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbe77d895fb48268589233ed218a973'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.256220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbe77d895fb48268589233ed218a973'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.264456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-4435d6c1-82bb-4d36-b807-b4dec41339ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbe77d895fb48268589233ed218a973'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.288277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1283/2534] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:28 2022] DELETE /identity/v3/users/bcbe77d895fb48268589233ed218a973 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:28.618607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:28.618607 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:28.644018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4f82-6d3e-4ea9-8ddd-402f1ef3254c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:28.715696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:28.716272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:28.716554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:28.716830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] PATH_INFO: `/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:28.718151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb2eac5b9ad471d82ee120b951d5a2c)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:28.720492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:28.785197 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb2eac5b9ad471d82ee120b951d5a2c', 'request_id': 'req-46a97109-f043-4247-a69b-84b25ac37042'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.791871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb2eac5b9ad471d82ee120b951d5a2c', 'request_id': 'req-46a97109-f043-4247-a69b-84b25ac37042'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.796833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:28.799571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb2eac5b9ad471d82ee120b951d5a2c', 'request_id': 'req-46a97109-f043-4247-a69b-84b25ac37042'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.814912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] The token cache is being invalidate because project 8fb2eac5b9ad471d82ee120b951d5a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:28.815244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.816079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-46a97109-f043-4247-a69b-84b25ac37042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:28.819058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1252/2535] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:28 2022] DELETE /identity/v3/projects/8fb2eac5b9ad471d82ee120b951d5a2c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:28.824159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:28.824699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:28.825188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:28.849481 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:28.853150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:28.886721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:28.923129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1284/2536] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:28.932447 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:28.932746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:28.933029 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:28.956975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:28.962539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:28.980811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1253/2537] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:28.985515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:28.996846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724925c3-9a98-4f20-b568-7be3d8c8808b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.002976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.003654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.003972 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.004380 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.005798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:29.006068 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.008372 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.034458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1285/2538] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:29.039057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.053235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22bb57-27c2-421e-8512-272f6c087d82 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.058455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.059326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.059708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.059998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.061359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.066273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.098234 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1254/2539] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:29 2022] POST /identity/v3/projects => generated 358 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:29.102526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.115253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203a55-4c10-48a7-b88f-c3866f408354 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.189756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.190682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.191124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.191631 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.192531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.194528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.219961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1286/2540] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:29 2022] POST /identity/v3/users => generated 280 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:29.224378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.255540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867391f1-adb2-4410-89c9-4f2b73a1119c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.264779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.266969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.268081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.269147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.270666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.274019 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.290283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1255/2541] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:29.291802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.303301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7665-8bb3-4ce8-93fb-d1c3276d34c3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.309677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.310804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.311166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.312079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.312593 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.314327 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098396b-8204-46ff-bf83-a8217dcbf118 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.330019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1287/2542] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:29.334786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.346377 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16c5c-26d4-4983-99bc-c25637f8f8bf admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.351074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.351815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.352099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.352380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] PATH_INFO: `/v3/projects/01a89c50423b46a6ac352f3c36e11643/users/f22368a7fe1344c9a9eabc09868f4a41/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.381535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a89c50423b46a6ac352f3c36e11643, user_id=f22368a7fe1344c9a9eabc09868f4a41, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.384635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.399878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1256/2543] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:29 2022] PUT /identity/v3/projects/01a89c50423b46a6ac352f3c36e11643/users/f22368a7fe1344c9a9eabc09868f4a41/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:29.410931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcce05-64a5-4000-863f-92a143df24de None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.411222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcce05-64a5-4000-863f-92a143df24de None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.411527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcce05-64a5-4000-863f-92a143df24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.443611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-94bcce05-64a5-4000-863f-92a143df24de None None] MFA Rules not processed for user `f22368a7fe1344c9a9eabc09868f4a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:29.444849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-94bcce05-64a5-4000-863f-92a143df24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:29.519320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1288/2544] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:29.523601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.593622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a186-6380-45ab-bc90-16fec1faaf08 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.598807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.599486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.599800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.600083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.600765 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.602713 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.633012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1257/2545] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:29 2022] POST /identity/v3/projects => generated 356 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:29.637387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcce05-64a5-4000-863f-92a143df24de None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.648958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcce05-64a5-4000-863f-92a143df24de None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.688995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:29.719961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.720757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.721123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.721462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.722747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.724223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.752922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1289/2546] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:29 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:29.754332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.765511 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac7d3-b780-4eea-a8cd-6eb71b92ee6e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.770748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.771325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.773788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.773926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.774635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.778614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.790253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1258/2547] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:29.794483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.805855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9e5ca-7547-4acf-bec5-e6c7a72ab51d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.810855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.812388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.812802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.815994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] PATH_INFO: `/v3/projects/b2ff9344140a46dfa2af9771a8c122e2/users/9156afe6bb344ff79954bfbac908e7ad/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.838986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ff9344140a46dfa2af9771a8c122e2, user_id=9156afe6bb344ff79954bfbac908e7ad, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.841919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.871406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.878982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1290/2548] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:29 2022] PUT /identity/v3/projects/b2ff9344140a46dfa2af9771a8c122e2/users/9156afe6bb344ff79954bfbac908e7ad/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:29.890498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd552-aa4b-4bf8-b74f-208c5305ef23 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:29.960601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:29.961417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:29.962005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:29.962587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:29.963385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:29.965105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52c6b-1b85-4532-b8be-57db12a29f8e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:29.971380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:29.981857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1259/2549] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:29 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:29.985036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:29.996499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec57f8-f0b4-4ae0-8713-fb05146debb8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:30.001583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:30.002275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:30.002558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:30.002835 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] PATH_INFO: `/v3/projects/b2ff9344140a46dfa2af9771a8c122e2/users/9156afe6bb344ff79954bfbac908e7ad/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:30.004867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ff9344140a46dfa2af9771a8c122e2, user_id=9156afe6bb344ff79954bfbac908e7ad, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:30.009812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:30.022800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1291/2550] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:29 2022] PUT /identity/v3/projects/b2ff9344140a46dfa2af9771a8c122e2/users/9156afe6bb344ff79954bfbac908e7ad/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:30.035152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:30.035528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:30.035785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:30.072474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] MFA Rules not processed for user `9156afe6bb344ff79954bfbac908e7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:30.073830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:30.159330 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1260/2551] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:30.175377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:30.177459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:30.249095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9351-3ceb-4990-b45f-1a6e8ef5e894 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:30.253133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:30.253876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:30.254301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:30.254671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:30.265918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:30.268017 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:30.285871 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1292/2552] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:30.384402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:30.395386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f6b2-c41c-4ffd-9b14-7a696381d09e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:30.399002 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:30.399691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:30.399974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:30.400564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:30.490858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:30.492660 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:30.504574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1261/2553] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:31.403078 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:31.406672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:31.485012 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20ff69-1cf9-4cb3-9fd3-97a94fd1524f service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:31.489805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:31.490465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:31.490747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:31.491027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] PATH_INFO: `/v3/users/44ac4775be0244df8fa0ee51a765c03a` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:31.492273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ac4775be0244df8fa0ee51a765c03a)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:31.494226 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:31.533355 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:31.556348 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ac4775be0244df8fa0ee51a765c03a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.557132 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ac4775be0244df8fa0ee51a765c03a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.557829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ac4775be0244df8fa0ee51a765c03a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.565636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ac4775be0244df8fa0ee51a765c03a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.572756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9d339fcb-3c12-4511-9ac8-6f7262a53c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ac4775be0244df8fa0ee51a765c03a'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.591112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1293/2554] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:31 2022] DELETE /identity/v3/users/44ac4775be0244df8fa0ee51a765c03a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:31.772058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:31.785228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1095242-ea2c-4fa4-a44b-2ecc7df98064 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:31.852601 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:31.853462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:31.853744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:31.854039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] PATH_INFO: `/v3/projects/c687166988fc4513a81e536a8f38ca3e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:31.855468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c687166988fc4513a81e536a8f38ca3e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:31.857405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:31.884586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:31.912888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c687166988fc4513a81e536a8f38ca3e', 'request_id': 'req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.919329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c687166988fc4513a81e536a8f38ca3e', 'request_id': 'req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.925390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c687166988fc4513a81e536a8f38ca3e', 'request_id': 'req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.939257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] The token cache is being invalidate because project c687166988fc4513a81e536a8f38ca3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:31.939688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.940337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c6e8704d-66fc-41bc-8b40-e2ed3e50b05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:31.941851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1262/2555] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:31 2022] DELETE /identity/v3/projects/c687166988fc4513a81e536a8f38ca3e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:31.947139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:31.947477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:31.947809 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:31.975516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:31.976746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:32.036047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1294/2556] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:32.045337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.045623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.045918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.067821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:32.069042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:32.078931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1263/2557] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:32.083336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.093652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008568f4-9d7f-4990-bb7e-06025dbf8948 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.099721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.100349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.100639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.100911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.101622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:32.101932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.103589 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.116980 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1295/2558] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:32.122350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.133682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a12a9-9195-4b1f-a004-b769f861322e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.140698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.141263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.141512 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.141819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.142483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.144451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.180950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1264/2559] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/projects => generated 366 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:32.182275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.193131 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb2-d26c-4952-b9a4-74a4fe4eb050 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.253730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.254366 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.254653 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.254965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.255678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.257627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.281278 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1296/2560] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:32.285584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.296432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b3205-33e8-43b8-a1a4-ad318d56b9b6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.302405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.303038 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.303340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.303649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.304348 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.305952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.316810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1265/2561] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:32.321148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.331603 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31201-212e-444f-9c3d-a5f70cb16d00 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.338503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.339145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.339464 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.339721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.340436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.342049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b3d38-cd33-431b-bf77-91447f3417a8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.354004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1297/2562] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:32.359689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.369979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f94f-a3f3-4ce5-bfd2-8442066b2b3a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.374900 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.375603 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.375892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.376162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] PATH_INFO: `/v3/projects/ee1ee640e2a04b8aacf123088599fdbe/users/dbd0cea7346744e580fc5f7e13d17940/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.391616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1ee640e2a04b8aacf123088599fdbe, user_id=dbd0cea7346744e580fc5f7e13d17940, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.394194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.409941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1266/2563] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:32 2022] PUT /identity/v3/projects/ee1ee640e2a04b8aacf123088599fdbe/users/dbd0cea7346744e580fc5f7e13d17940/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:32.421551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.422061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.422061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.449040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:32.452489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] MFA Rules not processed for user `dbd0cea7346744e580fc5f7e13d17940`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:32.454598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:32.533341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1298/2564] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:32.538873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.609560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ae46-cfca-450e-b462-aa92e6a23943 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.614540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.615178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.615501 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.615782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.616466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.618405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.647413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1267/2565] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/projects => generated 366 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:32.651918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.663139 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287dc6-f8b0-4cee-aeed-9dbec1995f60 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.725193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.725591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.725892 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.726166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.726853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.728823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.752158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1299/2566] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:32 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:32.756462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.767306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e827-275e-47f8-8d25-4f572c32a829 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.773150 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.774082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.774370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.774646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.775716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.777351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.792255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1268/2567] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:32.797357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.807990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89c89-56ae-42fa-bf3b-0500a487e4c1 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.812961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.813647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.813929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.814204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] PATH_INFO: `/v3/projects/4cbe475a355e44e0a972450041e547a6/users/f44336d907d74485866787c9604fd51d/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.842175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbe475a355e44e0a972450041e547a6, user_id=f44336d907d74485866787c9604fd51d, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.846660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.864173 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1300/2568] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:32 2022] PUT /identity/v3/projects/4cbe475a355e44e0a972450041e547a6/users/f44336d907d74485866787c9604fd51d/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:32.868540 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.878896 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8d1d-69ea-44db-b295-f6e014ad0fd0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.895505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:32.937871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.938415 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.938700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.938976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.939712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.941317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f77eb8-4941-4b8c-900a-8bde3f1d3ae0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.951057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1269/2569] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:32 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:32.955562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:32.966412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7cba-d0f8-4213-8408-73f04a3f59cf admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:32.972605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:32.973354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:32.973632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:32.973938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] PATH_INFO: `/v3/projects/4cbe475a355e44e0a972450041e547a6/users/f44336d907d74485866787c9604fd51d/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:32.976271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbe475a355e44e0a972450041e547a6, user_id=f44336d907d74485866787c9604fd51d, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:32.978947 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:32.991019 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1301/2570] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:32 2022] PUT /identity/v3/projects/4cbe475a355e44e0a972450041e547a6/users/f44336d907d74485866787c9604fd51d/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:33.006312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:33.006614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:33.006899 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:33.037941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] MFA Rules not processed for user `f44336d907d74485866787c9604fd51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:33.039163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:33.109510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:33.110486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1270/2571] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:33.111448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:33.122107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:33.123870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:33.173777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b803-4443-45c8-990c-a2cb73fc0d67 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:33.177750 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:33.178390 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:33.178681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:33.178959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:33.180876 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:33.188772 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50e58d-43f7-47e5-8432-249fe61a9f03 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:33.190859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:33.195383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:33.196164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:33.196451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:33.196727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:33.206982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:33.208610 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:33.218668 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1271/2572] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:33.248771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:33.250431 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:33.261436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1302/2573] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:33.462502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:33.471908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7971ad-dafc-46dd-a808-95ee95580334 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:33.475759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:33.476442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:33.476710 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:33.476982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:33.522507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:33.541285 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:33.542838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035c162-3f22-486c-8333-f02dfec44606 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:33.554455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1272/2574] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:36.362789 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:36.432454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a665f-15b8-431d-b5fd-cdf352dcf7c6 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:36.437806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:36.438466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:36.438756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:36.439031 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] PATH_INFO: `/v3/users/dbd0cea7346744e580fc5f7e13d17940` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:36.440276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd0cea7346744e580fc5f7e13d17940)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:36.442224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:36.493433 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd0cea7346744e580fc5f7e13d17940'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:36.494097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd0cea7346744e580fc5f7e13d17940'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:36.494706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd0cea7346744e580fc5f7e13d17940'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:36.502828 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd0cea7346744e580fc5f7e13d17940'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:36.510294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd0cea7346744e580fc5f7e13d17940'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:36.534677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1303/2575] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:36 2022] DELETE /identity/v3/users/dbd0cea7346744e580fc5f7e13d17940 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:36.536244 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:36.536814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:36.536814 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:36.560063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:36.561334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:36.624275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1273/2576] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:36.633975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:36.635551 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:36.671594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:36.701125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321dff-36e3-4870-b7bf-b0d0e6e96b55 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:36.705079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:36.705702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:36.705986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:36.706294 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:36.715496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:36.716948 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:36.726968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1304/2577] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:37.036910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:37.038599 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:37.052111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ddca8-0c14-4177-a539-d98bda455cec None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:37.057390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:37.058028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:37.058320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:37.058596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] PATH_INFO: `/v3/projects/ee1ee640e2a04b8aacf123088599fdbe` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:37.060074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1ee640e2a04b8aacf123088599fdbe)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:37.062788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:37.114039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1ee640e2a04b8aacf123088599fdbe', 'request_id': 'req-d8797a77-69ef-423d-9518-8d9be7110dd4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.120391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1ee640e2a04b8aacf123088599fdbe', 'request_id': 'req-d8797a77-69ef-423d-9518-8d9be7110dd4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.128094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1ee640e2a04b8aacf123088599fdbe', 'request_id': 'req-d8797a77-69ef-423d-9518-8d9be7110dd4'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.143471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] The token cache is being invalidate because project ee1ee640e2a04b8aacf123088599fdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:37.143760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.144413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.145934 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1274/2578] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:37 2022] DELETE /identity/v3/projects/ee1ee640e2a04b8aacf123088599fdbe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:37.150024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:37.160347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368cdbc-7fa4-49f2-b021-ba8c5d16d86e service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:37.216976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:37.217677 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:37.217970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:37.218248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] PATH_INFO: `/v3/users/f44336d907d74485866787c9604fd51d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:37.219592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44336d907d74485866787c9604fd51d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:37.221520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:37.273203 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44336d907d74485866787c9604fd51d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.273842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44336d907d74485866787c9604fd51d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.274475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44336d907d74485866787c9604fd51d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.284133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44336d907d74485866787c9604fd51d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.291147 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2e59bd50-1f9c-4766-8cc5-fde4ef8dc31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44336d907d74485866787c9604fd51d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.309678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1305/2579] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:37 2022] DELETE /identity/v3/users/f44336d907d74485866787c9604fd51d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:37.596323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:37.597811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:37.619542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797a77-69ef-423d-9518-8d9be7110dd4 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:37.686266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:37.686964 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:37.687245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:37.687595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] PATH_INFO: `/v3/projects/4cbe475a355e44e0a972450041e547a6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:37.688868 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbe475a355e44e0a972450041e547a6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:37.690816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:37.699876 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:37.749080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbe475a355e44e0a972450041e547a6', 'request_id': 'req-5401e08c-6b03-4d3a-8246-b64a00aee215'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.755675 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbe475a355e44e0a972450041e547a6', 'request_id': 'req-5401e08c-6b03-4d3a-8246-b64a00aee215'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.762560 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbe475a355e44e0a972450041e547a6', 'request_id': 'req-5401e08c-6b03-4d3a-8246-b64a00aee215'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.781464 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] The token cache is being invalidate because project 4cbe475a355e44e0a972450041e547a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:37.781819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.782920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5401e08c-6b03-4d3a-8246-b64a00aee215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:37.785367 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1275/2580] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:37 2022] DELETE /identity/v3/projects/4cbe475a355e44e0a972450041e547a6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:37.790475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:37.790967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:37.791065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:37.814406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:37.815678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:37.997308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:38.014874 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1306/2581] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:38.022910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.023201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.023523 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.048478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:38.049895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:38.059057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1276/2582] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:38.063640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.073416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c7ef-a190-4c2e-944d-88725e3f5507 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.078730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.079531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.079815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.080268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.080997 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:38.081306 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.082945 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.095869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1307/2583] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:38.100503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.110257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41dd52-abea-41b9-919c-41fded53045b None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.115427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.116030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.116320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.116604 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.117385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.119306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.150642 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1277/2584] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/projects => generated 388 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:38.159846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.166565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f557b-f53d-4dea-8714-9e9e7e9e1c1a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.225231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.231382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.231382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.231382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.231382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.231382 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.251881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1308/2585] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:38.256318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.267405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0caf3-ebf9-4967-bb45-4fd4aca7a15b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.272113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.272752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.273041 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.273318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.274052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.276082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.287151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1278/2586] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:38.291998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.303760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065905ca-7c52-4fd1-bd6a-ef381854434d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.309035 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.309660 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.309944 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.310218 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.310922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.312598 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce6e0c-2f79-4996-8d42-2e8c19121925 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.323191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1309/2587] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:38 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:38.328069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.342430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbacf-5073-4cd4-a17a-9e1e7bfd6dfe admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.350892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.351895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.352291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.352659 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] PATH_INFO: `/v3/projects/83d2c4b1cffb420cb77f5b8651dc6000/users/76661c966af849e7b59f3c377e8233b0/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.371227 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d2c4b1cffb420cb77f5b8651dc6000, user_id=76661c966af849e7b59f3c377e8233b0, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.374049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.390614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1279/2588] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:38 2022] PUT /identity/v3/projects/83d2c4b1cffb420cb77f5b8651dc6000/users/76661c966af849e7b59f3c377e8233b0/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:38.401523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.401812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.402086 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.431093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] MFA Rules not processed for user `76661c966af849e7b59f3c377e8233b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:38.432665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:38.501886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1310/2589] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:38.507075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.575617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269e2ac-518f-4750-84d6-c94814f7c32f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.581091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.581720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.582014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.582291 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.582972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.584910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.618557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1280/2590] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/projects => generated 388 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:38.625124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.636140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287ffc-15a4-4911-be78-9a0048eb6cad None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.684602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:38.700282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.701163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.701442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.701694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.702430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.704508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.728989 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1311/2591] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:38.735385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.748577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce985f-d736-4d7e-a7fc-b1aeb87db3a9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.753753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.754411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.754693 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.754963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.755712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.757345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.769035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1281/2592] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:38 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:38.773369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.786059 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ce0-762e-4e72-ad16-d850d2f5efed admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.790844 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.791580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.791841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.792115 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] PATH_INFO: `/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd/users/6ea62afd94a4485b8ecbf4e4a9acd02e/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.807643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75af4235753d4b9d8eb92c8f20ec2cbd, user_id=6ea62afd94a4485b8ecbf4e4a9acd02e, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.810292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.832079 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1312/2593] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:38 2022] PUT /identity/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd/users/6ea62afd94a4485b8ecbf4e4a9acd02e/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:38.837161 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.848286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870de698-4928-472e-9af2-dcad6fa9717f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.852200 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:38.914514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.915063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.915373 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.915658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.916368 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.918021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d12e4-c255-4746-913e-d16f6e230233 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.932633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1282/2594] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:38 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:38.933869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:38.946310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb725-d68f-4e3d-92b5-703e2162d2b2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:38.951982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:38.952898 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.953176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.953449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] PATH_INFO: `/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd/users/6ea62afd94a4485b8ecbf4e4a9acd02e/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:38.955759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75af4235753d4b9d8eb92c8f20ec2cbd, user_id=6ea62afd94a4485b8ecbf4e4a9acd02e, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:38.958408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:38.978371 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1313/2595] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:38 2022] PUT /identity/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd/users/6ea62afd94a4485b8ecbf4e4a9acd02e/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:38.990251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:38.990545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:38.990821 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.019788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] MFA Rules not processed for user `6ea62afd94a4485b8ecbf4e4a9acd02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:39.021011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:39.101672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1283/2596] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:39.114721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:39.117799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:39.182824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01a48-d2bd-4808-826b-339fe5f58315 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:39.187138 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:39.187800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:39.188081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:39.188373 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.198466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:39.199963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71f461-95d5-40be-bcea-3a93f490a876 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:39.210967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1314/2597] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:39.244791 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:39.316357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca940d-f257-4a50-ad9c-49e0a094c68d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:39.321184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:39.321839 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:39.322131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:39.322431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] PATH_INFO: `/v3/users/76661c966af849e7b59f3c377e8233b0` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.323676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=76661c966af849e7b59f3c377e8233b0)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:39.325883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:39.366793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:39.382734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76661c966af849e7b59f3c377e8233b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:39.390303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76661c966af849e7b59f3c377e8233b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:39.391008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76661c966af849e7b59f3c377e8233b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:39.400558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76661c966af849e7b59f3c377e8233b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:39.413339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76661c966af849e7b59f3c377e8233b0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:39.419537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1284/2598] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:39 2022] DELETE /identity/v3/users/76661c966af849e7b59f3c377e8233b0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:39.424610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:39.424910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:39.425192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.444954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:39.446254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:39.507204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1315/2599] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:39.520467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:39.522132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:39.591924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5299f6-ca0e-42f3-a920-c28968745bef admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:39.595944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:39.596583 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:39.596873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:39.597160 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.613911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:39.615733 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:39.628258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1285/2600] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:39.928794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:39.930668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:39.944503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e8c1f-fdc3-4c58-9864-01907f793889 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:39.949474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:39.950124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:39.950404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:39.950676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] PATH_INFO: `/v3/projects/83d2c4b1cffb420cb77f5b8651dc6000` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:39.951916 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d2c4b1cffb420cb77f5b8651dc6000)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:39.953883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:39.998810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:40.009914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d2c4b1cffb420cb77f5b8651dc6000', 'request_id': 'req-2b500f62-43f2-4697-9774-4258b5f603f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.017011 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d2c4b1cffb420cb77f5b8651dc6000', 'request_id': 'req-2b500f62-43f2-4697-9774-4258b5f603f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.022745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d2c4b1cffb420cb77f5b8651dc6000', 'request_id': 'req-2b500f62-43f2-4697-9774-4258b5f603f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.039624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] The token cache is being invalidate because project 83d2c4b1cffb420cb77f5b8651dc6000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:40.039866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.040511 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.042468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1316/2601] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:39 2022] DELETE /identity/v3/projects/83d2c4b1cffb420cb77f5b8651dc6000 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:40.046681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:40.057334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502a10e-ef96-4dee-8965-d79a2c4baf43 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:40.133908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:40.134739 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:40.135027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:40.135778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] PATH_INFO: `/v3/users/6ea62afd94a4485b8ecbf4e4a9acd02e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:40.137156 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea62afd94a4485b8ecbf4e4a9acd02e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:40.139183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:40.206997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea62afd94a4485b8ecbf4e4a9acd02e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.215716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:40.219936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea62afd94a4485b8ecbf4e4a9acd02e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.221107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea62afd94a4485b8ecbf4e4a9acd02e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.235185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea62afd94a4485b8ecbf4e4a9acd02e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.257118 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-9d4245e0-16b0-4e2b-b925-15347ce9b687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea62afd94a4485b8ecbf4e4a9acd02e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.266537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1286/2602] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:40 2022] DELETE /identity/v3/users/6ea62afd94a4485b8ecbf4e4a9acd02e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:40.612040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:40.614029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:40.635665 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500f62-43f2-4697-9774-4258b5f603f8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:40.711094 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:40.711823 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:40.712106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:40.712408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] PATH_INFO: `/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:40.713681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75af4235753d4b9d8eb92c8f20ec2cbd)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:40.716105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:40.764456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75af4235753d4b9d8eb92c8f20ec2cbd', 'request_id': 'req-9e39dfe8-cfcc-40e9-b250-313a604fa168'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.770627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75af4235753d4b9d8eb92c8f20ec2cbd', 'request_id': 'req-9e39dfe8-cfcc-40e9-b250-313a604fa168'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.776585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75af4235753d4b9d8eb92c8f20ec2cbd', 'request_id': 'req-9e39dfe8-cfcc-40e9-b250-313a604fa168'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.791091 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] The token cache is being invalidate because project 75af4235753d4b9d8eb92c8f20ec2cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:40.791401 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.792143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e39dfe8-cfcc-40e9-b250-313a604fa168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:40.793725 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1317/2603] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:40 2022] DELETE /identity/v3/projects/75af4235753d4b9d8eb92c8f20ec2cbd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:40.799889 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:40.800671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:40.800939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:40.833188 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:40.834413 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:41.035344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1287/2604] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:41.042965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.043496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.043496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.063550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:41.064855 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:41.073751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1318/2605] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:41.077835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.087957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b7b0-61a1-4403-98fa-7c80d6dd489e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.093342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.093946 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.094219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.094489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.095186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:41.095526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.097171 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.109771 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1288/2606] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:41.115799 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.125262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839d76-5bb8-4e2e-93ab-25b01606c76b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.130062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.130674 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.130953 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.131224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.131967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.133888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.168908 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1319/2607] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/projects => generated 386 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:41.173917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.188744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5293c47-b126-46ab-bfac-ea1a4b2e7655 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.248935 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.250119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.250589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.251039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.252242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.254690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.282359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1289/2608] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:41.286912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.297899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324924b-9692-4051-ba2f-c009c74eb00d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.302800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.303450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.303753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.304024 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.304831 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.306434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.317468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1320/2609] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:41 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:41.321835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.333680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f40c1-37e2-4685-8993-b3a4d9cee25f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.339307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.339955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.340255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.340522 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.341215 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.342826 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e585962-05c6-47bd-b9c1-1a63bc61d724 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.358223 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1290/2610] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:41 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:41.362395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.374722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79fac3-7886-42ae-9fa6-1b4a85db13e2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.380297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.380902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.381420 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.381638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] PATH_INFO: `/v3/projects/bfc6dc1c6f50436c826e169e3dd1a8ba/users/9894cd700b124a90a83fa88d683398b1/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.395608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:41.399233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc6dc1c6f50436c826e169e3dd1a8ba, user_id=9894cd700b124a90a83fa88d683398b1, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.403619 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.427424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1321/2611] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:41 2022] PUT /identity/v3/projects/bfc6dc1c6f50436c826e169e3dd1a8ba/users/9894cd700b124a90a83fa88d683398b1/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:41.434174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.434174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.434174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.464196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] MFA Rules not processed for user `9894cd700b124a90a83fa88d683398b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:41.465491 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:41.498800 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:41.564700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1291/2612] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:41.569753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.681428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79693-2815-4edc-ad26-c9a378dc3f1a admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.690508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.691438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.691792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.692152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.693005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.694973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.695701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.699537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:41.728760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1322/2613] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/projects => generated 384 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:41.732399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.795643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f80eb-8bd6-4008-ac91-cadebbb4f9b6 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.833710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e8b5-edb6-4774-a3bb-8e8ed6fdad44 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.841302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.842346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.842837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.843532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.844400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.847036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.850788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.851431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.851894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.852317 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.854264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:41.885681 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1323/2614] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:41 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:41.889968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.890725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.892855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.904310 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc736a5-6019-4d7a-adb4-30fed54bfd23 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.911810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.913090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.913438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.913779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.915175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.917199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:41.919712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1292/2615] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:41.935552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1324/2616] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:41 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:41.936632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:41.946637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4d28-e507-41d5-9b9c-6ee4613c2b89 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:41.951871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:41.952805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:41.953094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:41.953500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] PATH_INFO: `/v3/projects/2652bf2c0be64f0f83561f41084733f8/users/6c7628cc8b434664850bd4f8d8dd8672/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:41.985965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2652bf2c0be64f0f83561f41084733f8, user_id=6c7628cc8b434664850bd4f8d8dd8672, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:41.989219 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:42.005283 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1293/2617] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:41 2022] PUT /identity/v3/projects/2652bf2c0be64f0f83561f41084733f8/users/6c7628cc8b434664850bd4f8d8dd8672/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:42.010123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:42.022321 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85834d0-2551-474e-a275-3ff9c7cc4d0b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:42.117926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:42.130763 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:42.131449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:42.131734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:42.132008 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:42.132722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:42.137254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899ba7-bd91-4e7a-942b-10f4d6ca6acf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:42.161220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1325/2618] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:42 2022] GET /identity/v3/roles => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:42.165571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:42.191131 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961b17e-2b94-4bc4-baf8-184ec308f74e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:42.196487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:42.197184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:42.197468 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:42.197740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] PATH_INFO: `/v3/projects/2652bf2c0be64f0f83561f41084733f8/users/6c7628cc8b434664850bd4f8d8dd8672/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:42.199867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2652bf2c0be64f0f83561f41084733f8, user_id=6c7628cc8b434664850bd4f8d8dd8672, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:42.203555 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:42.215399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1294/2619] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:42 2022] PUT /identity/v3/projects/2652bf2c0be64f0f83561f41084733f8/users/6c7628cc8b434664850bd4f8d8dd8672/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:42.227622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:42.228040 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:42.228440 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:42.258554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] MFA Rules not processed for user `6c7628cc8b434664850bd4f8d8dd8672`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:42.260081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:42.334879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1326/2620] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:42.346475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:42.348361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:42.403794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:42.410455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd1cd-1d27-43e3-aed4-419fa5757e93 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:42.414816 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:42.415478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:42.415760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:42.416035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:42.473308 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:42.474783 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24487edc-618c-4b8c-b0df-891863415d9b service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:42.483837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1295/2621] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:44.101285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:44.104369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:44.197050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c7ee6-7b00-46c0-9c1b-205d75e18901 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:44.210295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:44.211376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:44.211816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:44.212417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] PATH_INFO: `/v3/users/3e73e96b5d9844f4af9209d279498158` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:44.214097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e73e96b5d9844f4af9209d279498158)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:44.216775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:44.362411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e73e96b5d9844f4af9209d279498158'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:44.363396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e73e96b5d9844f4af9209d279498158'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:44.364254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e73e96b5d9844f4af9209d279498158'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:44.373755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e73e96b5d9844f4af9209d279498158'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:44.381507 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e73e96b5d9844f4af9209d279498158'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:44.394766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:44.403741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1327/2622] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:44 2022] DELETE /identity/v3/users/3e73e96b5d9844f4af9209d279498158 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:44.408397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:44.408930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:44.408930 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:44.430113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:44.431235 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:44.495142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1296/2623] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:44.506178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:44.507705 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:44.569416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f387dae-4aaa-4016-b9ca-033251c6d17e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:44.573142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:44.573801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:44.574082 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:44.574359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:44.585240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:44.586704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:44.596609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1328/2624] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:45.342288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:45.344673 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:45.374769 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20709-8aa5-4448-af2a-10dcb6af0344 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:45.386444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:45.387008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:45.387315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:45.394758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] PATH_INFO: `/v3/projects/c1411093c2a44d83ae71f33284f183aa` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:45.401428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1411093c2a44d83ae71f33284f183aa)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:45.403855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:45.543183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1411093c2a44d83ae71f33284f183aa', 'request_id': 'req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.554271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1411093c2a44d83ae71f33284f183aa', 'request_id': 'req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.566199 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1411093c2a44d83ae71f33284f183aa', 'request_id': 'req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.581297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] The token cache is being invalidate because project c1411093c2a44d83ae71f33284f183aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:45.581706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.582425 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.585529 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1297/2625] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:45 2022] DELETE /identity/v3/projects/c1411093c2a44d83ae71f33284f183aa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:45.589827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:45.602771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68b05-2490-4b04-8c4d-bfb6960d7c56 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:45.668797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:45.669508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:45.669838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:45.670113 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] PATH_INFO: `/v3/users/8f88bacbb78e47099f812b22c6a115f5` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:45.672407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f88bacbb78e47099f812b22c6a115f5)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:45.674906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:45.744654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f88bacbb78e47099f812b22c6a115f5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.747544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f88bacbb78e47099f812b22c6a115f5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.750204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f88bacbb78e47099f812b22c6a115f5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.768600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f88bacbb78e47099f812b22c6a115f5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.778253 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-fddc8715-4b4a-445a-92fa-1fd118a99261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f88bacbb78e47099f812b22c6a115f5'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:45.801494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1329/2626] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:45 2022] DELETE /identity/v3/users/8f88bacbb78e47099f812b22c6a115f5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:46.160541 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.164060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:46.185784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4f2b-3566-4219-8a33-211ffdb3c0e7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.211115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:46.255760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.257110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.257616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.258048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] PATH_INFO: `/v3/projects/ec0649940bff4e938a97d0b770b6e62e` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.259648 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0649940bff4e938a97d0b770b6e62e)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.261652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.317546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0649940bff4e938a97d0b770b6e62e', 'request_id': 'req-f85f95dc-c041-4978-9ebd-9f72e10ecef0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:46.324274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0649940bff4e938a97d0b770b6e62e', 'request_id': 'req-f85f95dc-c041-4978-9ebd-9f72e10ecef0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:46.330061 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0649940bff4e938a97d0b770b6e62e', 'request_id': 'req-f85f95dc-c041-4978-9ebd-9f72e10ecef0'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:46.344979 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] The token cache is being invalidate because project ec0649940bff4e938a97d0b770b6e62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:46.345272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:46.345986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-f85f95dc-c041-4978-9ebd-9f72e10ecef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:46.347702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1298/2627] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:46 2022] DELETE /identity/v3/projects/ec0649940bff4e938a97d0b770b6e62e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:46.352657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.352940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.353219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.374174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:46.375398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:46.388270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:46.441477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1330/2628] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:46.449700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.450059 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.450339 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.471950 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:46.473441 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:46.484226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1299/2629] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:46.488459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.500708 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030111-829f-423a-bdc6-1ca5c8ce0763 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.505369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.505996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.506276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.506549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.507251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:46.507609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.509241 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.522753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1331/2630] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:46.527292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.537370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65d135-3fbe-455f-8b01-7ae6e5cbfa42 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.542755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.543443 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.544047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.544047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.544625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.546923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.579465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1300/2631] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:46 2022] POST /identity/v3/projects => generated 370 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:46.583783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.595060 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30149f-ef5c-409b-bf05-90aa179a12a4 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.667668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.668304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.668585 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.669001 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.669723 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.672716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.700686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1332/2632] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:46 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:46.707898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.721963 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e0a34-db2e-4441-b6d5-4e8b2947c799 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.727761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.728584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.728686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.729055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.729888 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.731537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.742740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1301/2633] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:46 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:46.746712 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.758435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c4ba3-24f3-4665-b5ef-be5bafc31651 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.765281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.766020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.766360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.766702 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.770853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.772858 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc711d07-1d09-4335-b97b-8260a463c1a1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.797542 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1333/2634] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:46 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:46.798922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:46.811855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d43b-0a44-41c7-97f2-76fd63146df8 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:46.819055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:46.820068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.820774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.821321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] PATH_INFO: `/v3/projects/2514953069d84adbbcd62cd6aafab97f/users/5fdbee0d217d4f6ab41a335d8ca25d4d/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.847148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2514953069d84adbbcd62cd6aafab97f, user_id=5fdbee0d217d4f6ab41a335d8ca25d4d, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:46.849894 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:46.875028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1302/2635] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:46 2022] PUT /identity/v3/projects/2514953069d84adbbcd62cd6aafab97f/users/5fdbee0d217d4f6ab41a335d8ca25d4d/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:46.889922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:46.890748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:46.891256 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:46.931867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] MFA Rules not processed for user `5fdbee0d217d4f6ab41a335d8ca25d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:46.933195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:47.052706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.054843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:47.060180 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1334/2636] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:47.064178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.078934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:47.122380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b75a-2a3f-4496-8fbd-d9b0ab96206e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.126382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.127018 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.127306 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.127629 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.129500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:47.134527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a31315-56ea-4ad1-bdf0-7f855b67f491 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.135320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:47.139825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.140536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.140884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.141240 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.141958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.144237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.187869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1335/2637] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:47 2022] POST /identity/v3/projects => generated 370 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:47.190092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.215700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.217683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.230071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1303/2638] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:47.267130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f382-ebef-400c-a600-afe6392a44e5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.272224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.272957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.273244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.273524 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.274198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.276494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.303227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1336/2639] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:47 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:47.306985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.319104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c13e-4f93-4b6a-96da-aa5f5b73a250 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.324786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.326121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.326121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.326121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.329626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.329626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.340748 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1304/2640] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:47 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:47.345482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.359300 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cead2-5060-4aa1-b532-c56e5b82bca6 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.365134 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.366013 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.366375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.366716 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] PATH_INFO: `/v3/projects/01ba9ce6b64c499e816fb9ed18447529/users/bd97d149e95a45c8a73ad06048c65b6c/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.404744 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ba9ce6b64c499e816fb9ed18447529, user_id=bd97d149e95a45c8a73ad06048c65b6c, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.409307 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.446904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1337/2641] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:47 2022] PUT /identity/v3/projects/01ba9ce6b64c499e816fb9ed18447529/users/bd97d149e95a45c8a73ad06048c65b6c/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:47.447941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.460110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d39c5b-4749-45ad-b41e-a22fd58aa9a2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.541729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.542500 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.542878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.543222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.544060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.546152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4b3a8-dcd8-4804-be56-62269794e08f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.567955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1305/2642] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:47 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:47.569270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.600487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597426a7-25da-482d-b2b9-da6f9f00e706 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.605760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.611583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.611583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.611583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] PATH_INFO: `/v3/projects/01ba9ce6b64c499e816fb9ed18447529/users/bd97d149e95a45c8a73ad06048c65b6c/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.611583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ba9ce6b64c499e816fb9ed18447529, user_id=bd97d149e95a45c8a73ad06048c65b6c, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.614779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.629347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1338/2643] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:47 2022] PUT /identity/v3/projects/01ba9ce6b64c499e816fb9ed18447529/users/bd97d149e95a45c8a73ad06048c65b6c/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:47.639913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.640315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.640688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.695586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] MFA Rules not processed for user `bd97d149e95a45c8a73ad06048c65b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:47.698598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:47.803986 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1306/2644] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:47.824600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:47.827963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:47.938195 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233439e-78d4-444b-8aba-b94b5855fed3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:47.942292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:47.942936 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:47.943285 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:47.943597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:47.950042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:47.954756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:47.965302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:47.979672 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1339/2645] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:48.029044 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:48.040428 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f2ee-00fe-4122-ab52-f9c50210e05e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:48.045846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:48.046546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:48.046832 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:48.047164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:48.056667 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:48.115277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:48.116837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:48.126082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1307/2646] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:49.452353 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:49.454140 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:49.522878 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79092d-b6ef-46b1-96a8-e3f6718f0fdc service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:49.528167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:49.528974 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:49.529295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:49.529688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] PATH_INFO: `/v3/users/9808a95e377143e2a77547c14e7932a4` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:49.531000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9808a95e377143e2a77547c14e7932a4)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:49.533039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:49.585083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9808a95e377143e2a77547c14e7932a4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:49.585650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9808a95e377143e2a77547c14e7932a4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:49.586257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9808a95e377143e2a77547c14e7932a4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:49.596417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9808a95e377143e2a77547c14e7932a4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:49.604801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9808a95e377143e2a77547c14e7932a4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:49.623233 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1340/2647] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:49 2022] DELETE /identity/v3/users/9808a95e377143e2a77547c14e7932a4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:49.823520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:49.837759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d14e-7bb9-4e33-896b-422312067412 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:49.955469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:49.956578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:49.957721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:49.958225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] PATH_INFO: `/v3/projects/14277b321e0043f9a0846cc4949465c7` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:49.961252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14277b321e0043f9a0846cc4949465c7)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:49.973105 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:50.053245 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14277b321e0043f9a0846cc4949465c7', 'request_id': 'req-aceefd4d-a195-40e7-99ce-c66e9447b142'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.059886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14277b321e0043f9a0846cc4949465c7', 'request_id': 'req-aceefd4d-a195-40e7-99ce-c66e9447b142'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.066112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14277b321e0043f9a0846cc4949465c7', 'request_id': 'req-aceefd4d-a195-40e7-99ce-c66e9447b142'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.079725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] The token cache is being invalidate because project 14277b321e0043f9a0846cc4949465c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:50.080021 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.080636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.082121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1308/2648] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:49 2022] DELETE /identity/v3/projects/14277b321e0043f9a0846cc4949465c7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:50.086539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:50.088042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:50.101564 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931481-b01d-4065-8c2b-68dbea4f3525 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:50.161424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:50.161984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:50.162270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:50.162519 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] PATH_INFO: `/v3/users/146f002d8092498cbc01710aefeb0e79` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:50.163896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146f002d8092498cbc01710aefeb0e79)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:50.165821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:50.180244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:50.216978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146f002d8092498cbc01710aefeb0e79'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.217778 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146f002d8092498cbc01710aefeb0e79'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.218309 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146f002d8092498cbc01710aefeb0e79'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.226552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146f002d8092498cbc01710aefeb0e79'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.234268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146f002d8092498cbc01710aefeb0e79'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.251859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1341/2649] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:50 2022] DELETE /identity/v3/users/146f002d8092498cbc01710aefeb0e79 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:50.434411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:50.436099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:50.449231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceefd4d-a195-40e7-99ce-c66e9447b142 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:50.519681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:50.540390 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:50.541063 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:50.541343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:50.541616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] PATH_INFO: `/v3/projects/a877a8c68bfb480c814f6b22633932d2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:50.542764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a877a8c68bfb480c814f6b22633932d2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:50.544698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:50.595081 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a877a8c68bfb480c814f6b22633932d2', 'request_id': 'req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.601249 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a877a8c68bfb480c814f6b22633932d2', 'request_id': 'req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.606855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a877a8c68bfb480c814f6b22633932d2', 'request_id': 'req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.620728 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] The token cache is being invalidate because project a877a8c68bfb480c814f6b22633932d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:50.621011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.621614 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-dedbdadb-dbee-4f5b-aae9-a7c4b5b095f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:50.623162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1309/2650] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:50 2022] DELETE /identity/v3/projects/a877a8c68bfb480c814f6b22633932d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:51.564891 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:51.566581 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:51.580573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb6d5c-f095-409b-aa60-8bcc4bcfd453 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:51.637566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:51.638220 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:51.638535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:51.638853 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] PATH_INFO: `/v3/users/5fdbee0d217d4f6ab41a335d8ca25d4d` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:51.640102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdbee0d217d4f6ab41a335d8ca25d4d)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:51.642033 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:51.698529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdbee0d217d4f6ab41a335d8ca25d4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:51.699199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdbee0d217d4f6ab41a335d8ca25d4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:51.699935 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdbee0d217d4f6ab41a335d8ca25d4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:51.707630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdbee0d217d4f6ab41a335d8ca25d4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:51.715378 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdbee0d217d4f6ab41a335d8ca25d4d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:51.734229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1342/2651] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:51 2022] DELETE /identity/v3/users/5fdbee0d217d4f6ab41a335d8ca25d4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:51.739229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:51.739726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:51.739726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:51.760058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:51.761363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:51.835400 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1310/2652] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:51.847238 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:51.848834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:51.863528 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:51.915912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee300e-e62b-4d0a-841e-8a02214b3a1e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:51.920178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:51.921007 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:51.921142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:51.921345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:51.931669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:51.933338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:51.945228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1343/2653] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:52.276806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:52.278823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:52.307067 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e9a75-146d-40ac-bdf3-a4e94bedb3d4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:52.313174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:52.313971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:52.314414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:52.314632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] PATH_INFO: `/v3/projects/2514953069d84adbbcd62cd6aafab97f` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:52.315855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2514953069d84adbbcd62cd6aafab97f)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:52.318113 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:52.369861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2514953069d84adbbcd62cd6aafab97f', 'request_id': 'req-daf75e76-bf72-48a6-a501-5db12ce3182e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.377760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2514953069d84adbbcd62cd6aafab97f', 'request_id': 'req-daf75e76-bf72-48a6-a501-5db12ce3182e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.383325 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2514953069d84adbbcd62cd6aafab97f', 'request_id': 'req-daf75e76-bf72-48a6-a501-5db12ce3182e'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.386121 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:52.398321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] The token cache is being invalidate because project 2514953069d84adbbcd62cd6aafab97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:52.399168 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.400132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.402869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1311/2654] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:52 2022] DELETE /identity/v3/projects/2514953069d84adbbcd62cd6aafab97f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:52.407471 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:52.418213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52d453-b797-44ea-810d-d165a864ecf6 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:52.486861 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:52.487626 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:52.487915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:52.488194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] PATH_INFO: `/v3/users/bd97d149e95a45c8a73ad06048c65b6c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:52.489847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd97d149e95a45c8a73ad06048c65b6c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:52.492112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:52.549002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd97d149e95a45c8a73ad06048c65b6c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.549720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd97d149e95a45c8a73ad06048c65b6c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.550406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd97d149e95a45c8a73ad06048c65b6c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.570688 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd97d149e95a45c8a73ad06048c65b6c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.578737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd97d149e95a45c8a73ad06048c65b6c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:52.597154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1344/2655] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:52 2022] DELETE /identity/v3/users/bd97d149e95a45c8a73ad06048c65b6c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:52.897453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:52.899671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:52.915383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf75e76-bf72-48a6-a501-5db12ce3182e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:52.938029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:52.939780 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:52.980154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:52.982700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:52.983727 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:52.984011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:52.984294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] PATH_INFO: `/v3/projects/01ba9ce6b64c499e816fb9ed18447529` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:52.985499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ba9ce6b64c499e816fb9ed18447529)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:52.987586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.011946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fee82-2f9d-4899-96d7-e62b5ac873cd admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.017627 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.018286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.018612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.018830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] PATH_INFO: `/v3/users/f22368a7fe1344c9a9eabc09868f4a41` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.020034 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22368a7fe1344c9a9eabc09868f4a41)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.021982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.035742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ba9ce6b64c499e816fb9ed18447529', 'request_id': 'req-330bea9f-2a2a-4f40-a469-1ca57299cf49'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.041789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ba9ce6b64c499e816fb9ed18447529', 'request_id': 'req-330bea9f-2a2a-4f40-a469-1ca57299cf49'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.048902 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ba9ce6b64c499e816fb9ed18447529', 'request_id': 'req-330bea9f-2a2a-4f40-a469-1ca57299cf49'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.061861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] The token cache is being invalidate because project 01ba9ce6b64c499e816fb9ed18447529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:53.062186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.063731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-330bea9f-2a2a-4f40-a469-1ca57299cf49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.065264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1312/2656] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:52 2022] DELETE /identity/v3/projects/01ba9ce6b64c499e816fb9ed18447529 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:53.069176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22368a7fe1344c9a9eabc09868f4a41'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.069825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22368a7fe1344c9a9eabc09868f4a41'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.069970 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448d48-323d-465a-a112-6a2834e07043 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.070201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448d48-323d-465a-a112-6a2834e07043 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.070488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22368a7fe1344c9a9eabc09868f4a41'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.070587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448d48-323d-465a-a112-6a2834e07043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.078435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22368a7fe1344c9a9eabc09868f4a41'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.086552 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6f5ff717-a6b3-43e9-8e1c-cab1d2360d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22368a7fe1344c9a9eabc09868f4a41'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.091271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-25448d48-323d-465a-a112-6a2834e07043 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:53.093046 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-25448d48-323d-465a-a112-6a2834e07043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.113641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1345/2657] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:52 2022] DELETE /identity/v3/users/f22368a7fe1344c9a9eabc09868f4a41 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:53.117889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.118178 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.118452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.137196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:53.138387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.157858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1313/2658] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:53.165679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.166321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.166424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.191304 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:53.192387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.214028 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:53.214592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1346/2659] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:53.226479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.228293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.268918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1314/2660] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:53.269898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.281385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e47f4b-ee5f-4d32-abf6-4ef2297a2ce2 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.286225 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.286782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.287069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.287349 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.288098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:53.288544 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.290255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.303999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1315/2661] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:53.308698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.312174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a363c-f090-4b2d-87da-b79b2db8bb7c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.317625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.318377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.318668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.318946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.325195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b8975-bd10-4a97-9942-04b7229e7c78 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.326594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:53.329797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.331138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.332017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.332318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.332540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.332670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.333253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.335149 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.343895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1347/2662] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:53.367778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1316/2663] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/projects => generated 388 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:53.372166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.383860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b704ae-8efd-4182-b6bc-d1778e93e9e6 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.448731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.449505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.449786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.450058 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.450757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.452926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.477739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1348/2664] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:53.481813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.494379 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e48472-8784-4eda-b022-121358f6782a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.509506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.510239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.510531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.510813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.511574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.513231 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.524503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1317/2665] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:53 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:53.528881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.539148 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76e09-1486-497d-8f27-e3875ce3bcc5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.544096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.544729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.545168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.545457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.546083 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.547721 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769fde-1b76-4f2d-9ee8-618b090672d3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.558365 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1349/2666] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:53 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:53.562851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.575547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d962-fad9-4285-9493-6e5ec7e7465e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.584115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.584901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.585182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.585465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] PATH_INFO: `/v3/projects/fcae33e35f1d46b1877c855bc1f8b5a2/users/f520304b3afd4e369fbce203a8658b91/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.603430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcae33e35f1d46b1877c855bc1f8b5a2, user_id=f520304b3afd4e369fbce203a8658b91, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.606203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.620638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1318/2667] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:53 2022] PUT /identity/v3/projects/fcae33e35f1d46b1877c855bc1f8b5a2/users/f520304b3afd4e369fbce203a8658b91/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:53.636201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.636201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.636201 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.637595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.639632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.678728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] MFA Rules not processed for user `f520304b3afd4e369fbce203a8658b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:53.680114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.725332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831b5c-125c-4786-9bd0-4702a0bd4d2c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.730802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.731704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.732066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.732465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] PATH_INFO: `/v3/projects/01a89c50423b46a6ac352f3c36e11643` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.733719 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a89c50423b46a6ac352f3c36e11643)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.735740 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.753696 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1350/2668] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:53.758170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.769156 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927308e3-4e94-4bec-acaf-6daa35b61052 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.775540 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.776032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.776722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.776985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.778062 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.781020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.792947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a89c50423b46a6ac352f3c36e11643', 'request_id': 'req-44ef64b7-5ca8-41a4-b126-7e8557de984c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.799622 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a89c50423b46a6ac352f3c36e11643', 'request_id': 'req-44ef64b7-5ca8-41a4-b126-7e8557de984c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.801857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:53.807461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a89c50423b46a6ac352f3c36e11643', 'request_id': 'req-44ef64b7-5ca8-41a4-b126-7e8557de984c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.816722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1351/2669] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/projects => generated 388 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:53.821027 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.831714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] The token cache is being invalidate because project 01a89c50423b46a6ac352f3c36e11643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:53.832360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.833246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:53.835709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1319/2670] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:53 2022] DELETE /identity/v3/projects/01a89c50423b46a6ac352f3c36e11643 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:53.840072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.841561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.875970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:53.898326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12388-be11-48a3-8d05-757dd2c4bb64 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.904025 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.904795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.905162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.905536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.906217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.908621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.914144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef64b7-5ca8-41a4-b126-7e8557de984c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.931123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.931943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.932286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.932680 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] PATH_INFO: `/v3/users/9156afe6bb344ff79954bfbac908e7ad` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.934537 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9156afe6bb344ff79954bfbac908e7ad)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.939846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1352/2671] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:53 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:53.940036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.941110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:53.943006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:53.957164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7fb3-3f1d-4b0c-b056-8f365ae3f5b8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:53.973534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:53.974189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:53.974475 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:53.974745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:53.975905 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:53.978097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:53.995845 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1353/2672] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:53 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:54.000558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.009918 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50972db-a7a3-4fcc-b104-1d1e612a9ded admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.010253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9156afe6bb344ff79954bfbac908e7ad'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.014704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.015458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.015706 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.015990 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] PATH_INFO: `/v3/projects/b98a3357b2724da790ec102d62750686/users/3dcef5bd4bb74ed482fa6d979dfefdf1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.019542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9156afe6bb344ff79954bfbac908e7ad'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.020297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9156afe6bb344ff79954bfbac908e7ad'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.028760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9156afe6bb344ff79954bfbac908e7ad'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.036884 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98a3357b2724da790ec102d62750686, user_id=3dcef5bd4bb74ed482fa6d979dfefdf1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.039743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.042142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9156afe6bb344ff79954bfbac908e7ad'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.048487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1320/2673] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:53 2022] DELETE /identity/v3/users/9156afe6bb344ff79954bfbac908e7ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:54.053473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1354/2674] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:53 2022] PUT /identity/v3/projects/b98a3357b2724da790ec102d62750686/users/3dcef5bd4bb74ed482fa6d979dfefdf1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:54.057449 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.059139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.126147 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2aa9-6c01-4579-b788-08070a2cb21d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.135014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:54.193042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.194410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.194709 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.194971 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.195732 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.197358 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a160c-b936-457f-9618-6060a5441c7b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.214767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1321/2675] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/roles => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:54.215661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.227731 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876bf56-1366-42ba-9afd-d04009154873 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.232620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.233488 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.233765 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.234045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] PATH_INFO: `/v3/projects/b98a3357b2724da790ec102d62750686/users/3dcef5bd4bb74ed482fa6d979dfefdf1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.236020 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98a3357b2724da790ec102d62750686, user_id=3dcef5bd4bb74ed482fa6d979dfefdf1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.238652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.249661 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1355/2676] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:54 2022] PUT /identity/v3/projects/b98a3357b2724da790ec102d62750686/users/3dcef5bd4bb74ed482fa6d979dfefdf1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:54.260383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.260681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.260965 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.290633 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] MFA Rules not processed for user `3dcef5bd4bb74ed482fa6d979dfefdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:54.291904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.348474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.350714 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.385672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1322/2677] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:54.402586 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.405098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.442759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff677e-1edb-4293-8afd-ecd4d4c09ee2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.448710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.450076 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.450435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.450859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] PATH_INFO: `/v3/projects/b2ff9344140a46dfa2af9771a8c122e2` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.453004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ff9344140a46dfa2af9771a8c122e2)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.455430 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.470820 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd3a6-792d-448f-b879-a8d84b9c52ef None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.474859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.475636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.476173 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.476548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.486386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.488383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b103464-2f41-4093-aa91-6e3a3c7ccedc service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.498903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1323/2678] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:54.510694 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ff9344140a46dfa2af9771a8c122e2', 'request_id': 'req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.517255 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ff9344140a46dfa2af9771a8c122e2', 'request_id': 'req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.522927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ff9344140a46dfa2af9771a8c122e2', 'request_id': 'req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.540403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] The token cache is being invalidate because project b2ff9344140a46dfa2af9771a8c122e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:54.540756 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.541442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.543208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1356/2679] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:54 2022] DELETE /identity/v3/projects/b2ff9344140a46dfa2af9771a8c122e2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:54.548355 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e8bb-8e1a-42c5-a188-1f0c6ee84b1c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.548725 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e8bb-8e1a-42c5-a188-1f0c6ee84b1c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.549080 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e8bb-8e1a-42c5-a188-1f0c6ee84b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.569214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.570921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.571141 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-ba87e8bb-8e1a-42c5-a188-1f0c6ee84b1c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:54.572341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ba87e8bb-8e1a-42c5-a188-1f0c6ee84b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.588792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:54.614286 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:54.645133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1324/2680] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:54.652659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66754e3-8e0f-4d7e-a23a-e36a7b24ea7d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.653935 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.654239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.654618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.659452 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.660186 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.660547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.660964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] PATH_INFO: `/v3/users/f520304b3afd4e369fbce203a8658b91` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.662216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f520304b3afd4e369fbce203a8658b91)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.664448 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.675170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:54.676440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.684383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1325/2681] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:54.688779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.698333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cfc96-a3a4-41c7-838c-6b89d978e1f5 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.703455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.704074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.704357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.704630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.705331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:54.705634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.707260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.714056 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f520304b3afd4e369fbce203a8658b91'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.714727 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f520304b3afd4e369fbce203a8658b91'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.715399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f520304b3afd4e369fbce203a8658b91'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.719296 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1326/2682] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:54.723549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.724374 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f520304b3afd4e369fbce203a8658b91'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.725397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.731824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5021c8eb-2cf7-409f-8e92-7606a73d2999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f520304b3afd4e369fbce203a8658b91'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:54.738212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa693-0b74-448f-b60f-8f8a6b1ea364 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.742834 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.743521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.743777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.744085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.744741 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.746613 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.750077 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1357/2683] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:54 2022] DELETE /identity/v3/users/f520304b3afd4e369fbce203a8658b91 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:54.754766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.755052 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.755322 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.775175 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:54.776408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.781408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1327/2684] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/projects => generated 382 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:54.782542 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.840628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1358/2685] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:54.850847 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.852336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:54.855074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485183a-c049-492a-a872-290b3cbc9aa9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.860981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.861744 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.862133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.862409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.863119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.865133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.887182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1328/2686] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:54 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:54.889736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:54.892035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.902797 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c5b7-33f7-44ce-9dad-55a428ee7ae8 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.907694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.908329 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.908617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.908927 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.909598 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.911202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.915938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe140a-fd00-4d88-9b2a-cd126d447eac None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.920609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.920888 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.921176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.921458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.922563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1329/2687] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:54.926664 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.932745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.934275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.937222 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfeab-bbb6-4a4a-ad0f-86bde8c7415f admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.942615 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.943266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.943579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.943858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.944596 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:54.944887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1359/2688] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:54.946195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31661414-b9e6-4ef3-81cd-936dc28b0c89 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:54.958365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1330/2689] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:54 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:54.962412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:54.972728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75112-1807-47de-be6f-388df3512868 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:54.977996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:54.978695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:54.978996 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:54.979406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] PATH_INFO: `/v3/projects/b2f3829857a74fd29065bd7ccb8c5fe1/users/0b2aaf89b80c49af8b37a51a91f656f8/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:54.996869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f3829857a74fd29065bd7ccb8c5fe1, user_id=0b2aaf89b80c49af8b37a51a91f656f8, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.000277 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.017302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1360/2690] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:54 2022] PUT /identity/v3/projects/b2f3829857a74fd29065bd7ccb8c5fe1/users/0b2aaf89b80c49af8b37a51a91f656f8/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:55.029453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73467-b388-4730-85e1-c184f230b055 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.030409 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73467-b388-4730-85e1-c184f230b055 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.030696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a73467-b388-4730-85e1-c184f230b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.074251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-91a73467-b388-4730-85e1-c184f230b055 None None] MFA Rules not processed for user `0b2aaf89b80c49af8b37a51a91f656f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:55.075506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-91a73467-b388-4730-85e1-c184f230b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.127624 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:55.146670 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1331/2691] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:55.151296 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.218089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee35e4c-c26b-4b37-b16b-ad3f5aa5f723 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.224473 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.225143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.225592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.225957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.226798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.228930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.236949 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a73467-b388-4730-85e1-c184f230b055 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.238594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-91a73467-b388-4730-85e1-c184f230b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.259055 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a73467-b388-4730-85e1-c184f230b055 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.260629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1361/2692] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:55 2022] POST /identity/v3/projects => generated 380 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:55.265479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.327073 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.327758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.328037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.328487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] PATH_INFO: `/v3/projects/fcae33e35f1d46b1877c855bc1f8b5a2` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.330297 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcae33e35f1d46b1877c855bc1f8b5a2)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.332408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.333050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201765-d3e7-43d4-b307-a13afaa6480b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.337637 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.338254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.338536 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.338812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.339500 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.341407 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.364468 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1362/2693] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:55 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:55.368254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.378280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42d3ff-d13e-40cf-b29f-0d98ac684c1d admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.380764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcae33e35f1d46b1877c855bc1f8b5a2', 'request_id': 'req-49657396-21e8-4f53-b7dd-c982491f03c9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.387151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcae33e35f1d46b1877c855bc1f8b5a2', 'request_id': 'req-49657396-21e8-4f53-b7dd-c982491f03c9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.393445 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcae33e35f1d46b1877c855bc1f8b5a2', 'request_id': 'req-49657396-21e8-4f53-b7dd-c982491f03c9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.405558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:55.408539 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] The token cache is being invalidate because project fcae33e35f1d46b1877c855bc1f8b5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:55.408831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.409564 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.411405 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1332/2694] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:55 2022] DELETE /identity/v3/projects/fcae33e35f1d46b1877c855bc1f8b5a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:55.415380 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.416757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.442768 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.443425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.444144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.444803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.445520 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.447649 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.458272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1363/2695] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:55 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:55.462650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.464346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.476521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f301-dcac-4109-998e-394ebe81df0e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.481597 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.482349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.482641 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.482933 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] PATH_INFO: `/v3/projects/00e7142e8d8c40958fca1bede303ad73/users/deb474e710634c86ab7210f1911ad24e/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.483571 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657396-21e8-4f53-b7dd-c982491f03c9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.490863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.491630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.491981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.492893 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] PATH_INFO: `/v3/users/3dcef5bd4bb74ed482fa6d979dfefdf1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.494210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcef5bd4bb74ed482fa6d979dfefdf1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.496397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.499897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7142e8d8c40958fca1bede303ad73, user_id=deb474e710634c86ab7210f1911ad24e, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.502592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.519324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1364/2696] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:55 2022] PUT /identity/v3/projects/00e7142e8d8c40958fca1bede303ad73/users/deb474e710634c86ab7210f1911ad24e/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:55.525189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.526904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:55.562139 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcef5bd4bb74ed482fa6d979dfefdf1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.569528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcef5bd4bb74ed482fa6d979dfefdf1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.570243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcef5bd4bb74ed482fa6d979dfefdf1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.578763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcef5bd4bb74ed482fa6d979dfefdf1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.591182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcef5bd4bb74ed482fa6d979dfefdf1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:55.592912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8a9f-d74a-42ca-9fa7-7d7dd3c2745e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.597547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1333/2697] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:55 2022] DELETE /identity/v3/users/3dcef5bd4bb74ed482fa6d979dfefdf1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:55.600605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.600605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.600605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.600605 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.601000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.601899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedbda-c4e4-4523-9e77-16c534d65653 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.612508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1365/2698] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:55 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:55.616785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.618163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.683531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071d9f-6964-4f13-b4d7-071118add567 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.688434 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.689119 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.689385 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.689662 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] PATH_INFO: `/v3/projects/00e7142e8d8c40958fca1bede303ad73/users/deb474e710634c86ab7210f1911ad24e/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.691653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7142e8d8c40958fca1bede303ad73, user_id=deb474e710634c86ab7210f1911ad24e, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.694276 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.705483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1334/2699] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:55 2022] PUT /identity/v3/projects/00e7142e8d8c40958fca1bede303ad73/users/deb474e710634c86ab7210f1911ad24e/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:55.715899 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.716399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.716512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.761515 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] MFA Rules not processed for user `deb474e710634c86ab7210f1911ad24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:55.762842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.840006 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1366/2700] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:55.852917 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.854745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.881541 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:55.883227 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:55.887741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:55.921972 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460b2-3810-438a-808b-8d946ccf243d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:55.926006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:55.926641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:55.926928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:55.927195 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:55.950439 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:55.952342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ea31e-f3b8-4459-9813-006cbba62614 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:55.962202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1335/2701] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:56.034150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff6eb4-d6b8-4b92-8d71-49135e1bffc0 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.039050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.039736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.040021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.040290 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] PATH_INFO: `/v3/projects/b98a3357b2724da790ec102d62750686` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.041467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98a3357b2724da790ec102d62750686)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.044399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.096305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98a3357b2724da790ec102d62750686', 'request_id': 'req-bf95cef6-6589-45dd-be2a-0c536abe308e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.104271 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98a3357b2724da790ec102d62750686', 'request_id': 'req-bf95cef6-6589-45dd-be2a-0c536abe308e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.110558 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98a3357b2724da790ec102d62750686', 'request_id': 'req-bf95cef6-6589-45dd-be2a-0c536abe308e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.125615 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] The token cache is being invalidate because project b98a3357b2724da790ec102d62750686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:56.125843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.126492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bf95cef6-6589-45dd-be2a-0c536abe308e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.128347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1367/2702] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:55 2022] DELETE /identity/v3/projects/b98a3357b2724da790ec102d62750686 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:56.133394 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.133681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.133961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.163627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:56.202370 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:56.203643 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.265411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1336/2703] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:56.273539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.273663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.273955 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.295509 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:56.296701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.304917 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1368/2704] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:56.308036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.308587 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.308881 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.318639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3cf3b-dce3-457c-a2d7-b71c115fcf17 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.323346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.323987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.324269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.324549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.325254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:56.325565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.327339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.339320 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1369/2705] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:56.344747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.354836 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728dc1a-eb24-4059-918b-4a9ee14cc301 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.359788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.360394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.360676 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.360942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.361630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.363559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.383805 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f299-4fdb-44ef-8ec8-cb0b75e7ab5c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.388563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb474e710634c86ab7210f1911ad24e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e7142e8d8c40958fca1bede303ad73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.389360 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.389647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.389924 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.390632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:56.390948 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.391211 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1370/2706] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/projects => generated 374 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:56.392708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.395408 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.404668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:56.409066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1337/2707] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:51:56.410120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.421220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bc208-4cb8-4a29-b9ab-32942f1a30f0 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.463231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cf97a-2391-4248-b112-b12e5c5d97c0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.468212 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.468832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.469112 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.469389 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.470044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.472016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.479626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb474e710634c86ab7210f1911ad24e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e7142e8d8c40958fca1bede303ad73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.480260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.480549 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.480837 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.481507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.483474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.495832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1371/2708] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:56.500092 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.510651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4109-9c7e-48a2-8738-42ae0295dc22 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.515392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.516010 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.516289 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.516562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.516686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1338/2709] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/projects => generated 354 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:56.517262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.518851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.520561 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.530178 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:56.530340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1372/2710] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:56.534678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.549375 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149b0b-8ab4-4754-9cc6-67603f4f0818 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.600789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518615a-7b1e-44ff-94b7-f1280c941293 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.605631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb474e710634c86ab7210f1911ad24e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e7142e8d8c40958fca1bede303ad73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.606271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.606580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.606892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.607843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:56.608192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.609812 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.616571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.617200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.617479 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.617751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.618444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.620122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.621552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1339/2711] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:56.631229 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1373/2712] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:56.635639 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.646626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd15c-98ab-4107-9d99-07a4e0e59b51 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.651597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.652273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.652559 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.652841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] PATH_INFO: `/v3/projects/cbb0cfaba7764710bdce55e0d44d4d87/users/7bfa06d4c28345bca2a6fb5335d4af0b/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.660503 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.669455 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb0cfaba7764710bdce55e0d44d4d87, user_id=7bfa06d4c28345bca2a6fb5335d4af0b, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.671247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96a2d-3126-4407-a98a-08d91590301f admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.673752 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19605d-b162-4222-bdf7-5f15899c3cf4 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.678046 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb474e710634c86ab7210f1911ad24e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00e7142e8d8c40958fca1bede303ad73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.678926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.679247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.679602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] PATH_INFO: `/v3/projects/b02961fc4a1b47a49e9a50794475217c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.681317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b02961fc4a1b47a49e9a50794475217c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.683266 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.688170 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1340/2713] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:56 2022] PUT /identity/v3/projects/cbb0cfaba7764710bdce55e0d44d4d87/users/7bfa06d4c28345bca2a6fb5335d4af0b/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:56.699463 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.699718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.700030 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.727636 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] MFA Rules not processed for user `7bfa06d4c28345bca2a6fb5335d4af0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:56.729176 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.733673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02961fc4a1b47a49e9a50794475217c', 'request_id': 'req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.741367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02961fc4a1b47a49e9a50794475217c', 'request_id': 'req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.747149 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02961fc4a1b47a49e9a50794475217c', 'request_id': 'req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.762018 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] The token cache is being invalidate because project b02961fc4a1b47a49e9a50794475217c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:56.762304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.762954 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:56.764673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1374/2714] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:56 2022] DELETE /identity/v3/projects/b02961fc4a1b47a49e9a50794475217c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:56.800365 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1341/2715] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:56.812414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.813834 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.817662 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:56.899580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ed4d-da58-4bd1-a2e4-35014b3f4ef4 tempest-VolumeQuotaClassesTest-920001998 tempest-VolumeQuotaClassesTest-920001998-project-admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:56.903461 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:56.904089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:56.904654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:56.905176 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:56.914061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:56.915573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:56.926274 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1375/2716] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:56.948905 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.950515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:56.967842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:56.969982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.024584 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560a091-2878-4c3e-935b-b05de585d599 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.030213 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.030857 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.031135 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.031427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] PATH_INFO: `/v3/users/7bfa06d4c28345bca2a6fb5335d4af0b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.032590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bfa06d4c28345bca2a6fb5335d4af0b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.034506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.037216 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcc02b-479a-4d22-8b23-8d299f00201a service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.041998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.042638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.042919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.043193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] PATH_INFO: `/v3/users/0b2aaf89b80c49af8b37a51a91f656f8` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.044453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2aaf89b80c49af8b37a51a91f656f8)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.045014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:57.046958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.087891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bfa06d4c28345bca2a6fb5335d4af0b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.095819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2aaf89b80c49af8b37a51a91f656f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.096032 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bfa06d4c28345bca2a6fb5335d4af0b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.096592 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2aaf89b80c49af8b37a51a91f656f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.096714 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bfa06d4c28345bca2a6fb5335d4af0b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.097213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2aaf89b80c49af8b37a51a91f656f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.104856 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bfa06d4c28345bca2a6fb5335d4af0b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.108794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2aaf89b80c49af8b37a51a91f656f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.115816 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3785c65c-c00e-4da8-9481-57316aa65c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2aaf89b80c49af8b37a51a91f656f8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.119272 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-6b7a292e-3a51-4ce7-976e-303539731971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bfa06d4c28345bca2a6fb5335d4af0b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.125767 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1342/2717] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:56 2022] DELETE /identity/v3/users/7bfa06d4c28345bca2a6fb5335d4af0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:57.130815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.131280 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.131726 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.142560 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1376/2718] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:56 2022] DELETE /identity/v3/users/0b2aaf89b80c49af8b37a51a91f656f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:57.144126 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.144439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.144754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.152499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:57.153757 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.166669 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:57.167890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.174205 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:57.222162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1343/2719] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:57.232760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.234514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.234760 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1377/2720] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:57.243887 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.245483 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.293922 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1def97e-b16a-40cc-a847-e81570bfb667 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.298017 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.298653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.298935 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.299214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.303332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9c364-482e-4517-9605-35e8f153c118 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.307157 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.307807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.308087 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.308356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.308684 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.310112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.317906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.319466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.320027 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1344/2721] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:57.329648 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1378/2722] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:51:57.650431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.652006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.668183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551004-4ce2-4abf-a23c-6bb71a127f28 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.673913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.674789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.675051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.675406 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] PATH_INFO: `/v3/users/9894cd700b124a90a83fa88d683398b1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.677536 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9894cd700b124a90a83fa88d683398b1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.680909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.702748 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.704625 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.719338 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb9aa-9a0d-4704-baf9-b77c99acfd5d service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.723274 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:57.725005 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.725843 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.726123 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.726406 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] PATH_INFO: `/v3/projects/cbb0cfaba7764710bdce55e0d44d4d87` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.727775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb0cfaba7764710bdce55e0d44d4d87)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.730287 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.763546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9894cd700b124a90a83fa88d683398b1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.774517 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9894cd700b124a90a83fa88d683398b1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.776196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9894cd700b124a90a83fa88d683398b1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.786618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9894cd700b124a90a83fa88d683398b1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.793635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb0cfaba7764710bdce55e0d44d4d87', 'request_id': 'req-5d9594d7-d188-4cc3-b6df-374c20af06cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.800565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb0cfaba7764710bdce55e0d44d4d87', 'request_id': 'req-5d9594d7-d188-4cc3-b6df-374c20af06cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.800960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9894cd700b124a90a83fa88d683398b1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.806526 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb0cfaba7764710bdce55e0d44d4d87', 'request_id': 'req-5d9594d7-d188-4cc3-b6df-374c20af06cd'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.807123 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1345/2723] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:57 2022] DELETE /identity/v3/users/9894cd700b124a90a83fa88d683398b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:57.807952 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.809312 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.821144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] The token cache is being invalidate because project cbb0cfaba7764710bdce55e0d44d4d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:57.821508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.822395 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5d9594d7-d188-4cc3-b6df-374c20af06cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.824837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1379/2724] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:57 2022] DELETE /identity/v3/projects/cbb0cfaba7764710bdce55e0d44d4d87 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:57.826826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1d83-94fd-4e1e-bc4a-4d96d9fc7119 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.827295 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1d83-94fd-4e1e-bc4a-4d96d9fc7119 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.827829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1d83-94fd-4e1e-bc4a-4d96d9fc7119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.847447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9b1c1d83-94fd-4e1e-bc4a-4d96d9fc7119 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:57.848656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9b1c1d83-94fd-4e1e-bc4a-4d96d9fc7119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.882257 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:57.889722 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d11e0-d018-441b-9c1c-a4a7edab28c3 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:57.895142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:57.895871 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.896151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.896657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] PATH_INFO: `/v3/projects/b2f3829857a74fd29065bd7ccb8c5fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.897836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f3829857a74fd29065bd7ccb8c5fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:57.900159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:57.916946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1380/2725] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:57.918234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:57.918632 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:57.918910 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:57.942234 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:57.943825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:57.953410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f3829857a74fd29065bd7ccb8c5fe1', 'request_id': 'req-c7a81689-4cf3-48f3-9d13-55184955d8b9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.959851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f3829857a74fd29065bd7ccb8c5fe1', 'request_id': 'req-c7a81689-4cf3-48f3-9d13-55184955d8b9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.965545 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f3829857a74fd29065bd7ccb8c5fe1', 'request_id': 'req-c7a81689-4cf3-48f3-9d13-55184955d8b9'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.982958 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] The token cache is being invalidate because project b2f3829857a74fd29065bd7ccb8c5fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:57.983627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.984301 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:57.986094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1346/2726] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:57 2022] DELETE /identity/v3/projects/b2f3829857a74fd29065bd7ccb8c5fe1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:57.989646 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:57.990994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.015259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1381/2727] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:58.016146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.017409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.029810 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc566-598e-49c9-8068-8517ecbac66c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.034383 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.035021 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.035164 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:58.035298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.035599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] PATH_INFO: `/v3/users/deb474e710634c86ab7210f1911ad24e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.036957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb474e710634c86ab7210f1911ad24e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.038942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.062702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81689-4cf3-48f3-9d13-55184955d8b9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.067316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.067981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.068424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.068679 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.070941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.084550 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.086012 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0193-4e94-4518-860b-1ce0bd991a79 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.090142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb474e710634c86ab7210f1911ad24e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.090812 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb474e710634c86ab7210f1911ad24e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.091484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb474e710634c86ab7210f1911ad24e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.096011 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1347/2728] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:58.097460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.097692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.097975 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.100206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb474e710634c86ab7210f1911ad24e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.109499 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb474e710634c86ab7210f1911ad24e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.118683 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:58.120287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.134483 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1348/2729] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:58.134827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1382/2730] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:58 2022] DELETE /identity/v3/users/deb474e710634c86ab7210f1911ad24e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:58.136175 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.147091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6145-13ff-4c96-bb33-aeaa488fce03 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.212462 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.213180 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.213470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.213883 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.214589 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:58.214918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.216759 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.249262 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1349/2731] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:58.249369 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.257738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa646d-2642-426f-9558-0168d38d8984 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.263559 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.264496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.264496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.264496 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.267174 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.268387 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.306088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1383/2732] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:58 2022] POST /identity/v3/projects => generated 384 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:58.314287 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.329906 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353352d-7227-4001-abe0-d74cee833ceb admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.436619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.437265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.437554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.437836 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.438518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.440580 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.471320 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1350/2733] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:58 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:58.471449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.480030 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daed1b-89c2-4dcb-9709-6753b2cf5198 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.485651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.486293 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.486576 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.486851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.487718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.489236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.501755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1384/2734] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:58.505845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.517088 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abb016-63c4-4122-b079-b3d777110895 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.522538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.523316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.523773 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.523907 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.524608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.526734 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.541264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1351/2735] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:51:58.545946 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.557250 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac56bdf-4e76-4a39-b419-3cd86714e878 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.567512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.568264 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.568557 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.568903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] PATH_INFO: `/v3/projects/2508b437eb7248cc96db6094d6ee1bd8/users/5f96ea7de0d74d2393afd458cb6ff74c/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.576620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.579678 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.603441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2508b437eb7248cc96db6094d6ee1bd8, user_id=5f96ea7de0d74d2393afd458cb6ff74c, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.608245 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.611345 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:58.616702 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc3cb5-3c51-46f7-924f-1d6ff04f1c60 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.624774 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.625493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.625901 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.626275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] PATH_INFO: `/v3/projects/bfc6dc1c6f50436c826e169e3dd1a8ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.627838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc6dc1c6f50436c826e169e3dd1a8ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.630172 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.636879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1385/2736] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:58 2022] PUT /identity/v3/projects/2508b437eb7248cc96db6094d6ee1bd8/users/5f96ea7de0d74d2393afd458cb6ff74c/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:58.639609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.640691 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.679891 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:58.693490 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc6dc1c6f50436c826e169e3dd1a8ba', 'request_id': 'req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.699802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc6dc1c6f50436c826e169e3dd1a8ba', 'request_id': 'req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.705572 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc6dc1c6f50436c826e169e3dd1a8ba', 'request_id': 'req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.720841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] The token cache is being invalidate because project bfc6dc1c6f50436c826e169e3dd1a8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:58.721246 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.721974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-0bbd9b21-d1e0-419c-b479-c1802ad05e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.723869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1352/2737] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:58 2022] DELETE /identity/v3/projects/bfc6dc1c6f50436c826e169e3dd1a8ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:58.725229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.725547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.725869 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.728276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817d3d-075a-4f0f-9b48-dc0271cd40d2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.744628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:58.745845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.785159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.785832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.786125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.786415 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] PATH_INFO: `/v3/projects/00e7142e8d8c40958fca1bede303ad73` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.787651 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e7142e8d8c40958fca1bede303ad73)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.789800 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.808623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1353/2738] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:58.812700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.812700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.825498 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256a449-b5fa-4bc6-9747-a8e25e89f853 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.831408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:58.832106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.832410 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.832676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] PATH_INFO: `/v3/users/6c7628cc8b434664850bd4f8d8dd8672` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.833940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7628cc8b434664850bd4f8d8dd8672)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:58.835941 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:58.842747 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e7142e8d8c40958fca1bede303ad73', 'request_id': 'req-5bd1100c-21e3-468e-bd03-445e2af258c9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.850072 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e7142e8d8c40958fca1bede303ad73', 'request_id': 'req-5bd1100c-21e3-468e-bd03-445e2af258c9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.857127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e7142e8d8c40958fca1bede303ad73', 'request_id': 'req-5bd1100c-21e3-468e-bd03-445e2af258c9'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.873090 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] The token cache is being invalidate because project 00e7142e8d8c40958fca1bede303ad73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:58.873699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.874646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.876412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1386/2739] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:58 2022] DELETE /identity/v3/projects/00e7142e8d8c40958fca1bede303ad73 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:58.877214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:58.878566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:58.892480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7628cc8b434664850bd4f8d8dd8672'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.900936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7628cc8b434664850bd4f8d8dd8672'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.901707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7628cc8b434664850bd4f8d8dd8672'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.910369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7628cc8b434664850bd4f8d8dd8672'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.914994 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:58.924974 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-df91517b-3901-4f43-a862-d6e5d8add24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7628cc8b434664850bd4f8d8dd8672'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:58.932192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1354/2740] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:51:58 2022] DELETE /identity/v3/users/6c7628cc8b434664850bd4f8d8dd8672 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:58.933369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67ba1e-55c1-41fa-9eee-79fbc88f9f39 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:58.933641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67ba1e-55c1-41fa-9eee-79fbc88f9f39 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:58.933926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67ba1e-55c1-41fa-9eee-79fbc88f9f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:58.942643 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1100c-21e3-468e-bd03-445e2af258c9 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:58.957378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-cc67ba1e-55c1-41fa-9eee-79fbc88f9f39 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:58.964706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-cc67ba1e-55c1-41fa-9eee-79fbc88f9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.007515 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:59.007965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.008325 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.008638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.008920 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.012336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.051688 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1355/2741] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:59.059807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.060127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.060499 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.083004 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:59.088906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.089056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.090510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.099609 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1356/2742] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:59.101927 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1387/2743] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:51:59.103788 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.113090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5ee6-e14e-44fe-b7a8-4fe338706b27 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.118982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.119717 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.120065 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.120408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.121228 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:59.121847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.123913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.139867 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1357/2744] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:59.145164 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.156718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c50f-ff85-4c83-abe8-3ac2fd84549d service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.161792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.162425 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.162987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.162987 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.163775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.165682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.197539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1388/2745] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/projects => generated 388 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:59.202628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.213846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e7cd-c2bf-4a27-bdf3-1372768b1d96 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.287301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.289347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.299944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.303375 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.303699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.303982 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.304691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.306859 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.337257 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1358/2746] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:59.339551 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.353650 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b381e-4513-485b-be09-6df84d2406b1 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.359427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.360166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.360448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.360745 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.361505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.363187 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.375790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1359/2747] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:59 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:59.379843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.388656 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291014bc-1497-4239-ae2c-de96213d192c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.390936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d69f-e3b5-4968-bacd-6e67390919fc admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.394565 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.395568 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.395864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.396145 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] PATH_INFO: `/v3/projects/2652bf2c0be64f0f83561f41084733f8` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.397640 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2652bf2c0be64f0f83561f41084733f8)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.400232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.400911 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.401625 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.401966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.402323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.403084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.404855 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.417637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1360/2748] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:59 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:51:59.423445 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:59.423997 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.444042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619bad8-f71c-450e-9bca-cd02c7ce86c2 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.451163 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.452024 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.452595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.453617 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] PATH_INFO: `/v3/projects/91eda29288aa48ee9a5bcbfe18d30683/users/89b64b3b15f8421fa9b4cd2f383a6667/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.480070 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91eda29288aa48ee9a5bcbfe18d30683, user_id=89b64b3b15f8421fa9b4cd2f383a6667, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.480998 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2652bf2c0be64f0f83561f41084733f8', 'request_id': 'req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:59.487631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5eb67-a0d7-4140-bd9f-7ca469f15067 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.493535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2652bf2c0be64f0f83561f41084733f8', 'request_id': 'req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:59.508143 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2652bf2c0be64f0f83561f41084733f8', 'request_id': 'req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:59.512558 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1361/2749] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:51:59 2022] PUT /identity/v3/projects/91eda29288aa48ee9a5bcbfe18d30683/users/89b64b3b15f8421fa9b4cd2f383a6667/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:51:59.525429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.525692 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.525968 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.526141 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] The token cache is being invalidate because project 2652bf2c0be64f0f83561f41084733f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:51:59.526411 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:59.527214 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2d5105e0-fb42-487d-b8bb-d6dfe4aa3eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:51:59.529469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1389/2750] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:51:59 2022] DELETE /identity/v3/projects/2652bf2c0be64f0f83561f41084733f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:51:59.537982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f78cd-55db-42c8-b2d7-da1eded72a34 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.538359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f78cd-55db-42c8-b2d7-da1eded72a34 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.538704 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f78cd-55db-42c8-b2d7-da1eded72a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.565783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2a4f78cd-55db-42c8-b2d7-da1eded72a34 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:59.567523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2a4f78cd-55db-42c8-b2d7-da1eded72a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.570838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] MFA Rules not processed for user `89b64b3b15f8421fa9b4cd2f383a6667`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:59.572094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.657148 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:59.673121 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1390/2751] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:51:59.681341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.681624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.681896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.686357 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1362/2752] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:59.690423 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.691819 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.703085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:59.704265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.706543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c4d4a-6717-47a8-927b-9fcd6c62d168 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.711133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.712193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.712193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.712436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.713128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.715391 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.716367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1391/2753] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:51:59.720991 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.730272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f526bd1-d0ed-4e80-9ee8-864641707d2b None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.735114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.735822 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.736159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.736535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.737347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:51:59.737655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.739265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.750976 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1363/2754] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/projects => generated 390 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:51:59.751782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.755531 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1392/2755] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:51:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:51:59.757155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.768127 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664b048-d960-4ccb-9ed6-53c032e86bc5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.839292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e977cc-9da1-494b-8db0-deba51ac3b5a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.848618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.850785 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.851331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.851658 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.852620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.855096 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28538d-66fe-49b9-80c5-fc268a7a5b21 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.856611 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.857364 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.857726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.858130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.859036 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.871188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:51:59.894229 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1364/2756] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/users => generated 302 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:59.895887 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.896266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.896627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.902198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1393/2757] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/projects => generated 386 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:51:59.902198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:51:59.919210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:59.933690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] MFA Rules not processed for user `5f96ea7de0d74d2393afd458cb6ff74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:51:59.935885 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:51:59.983204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2863fe-176f-4ac5-a2be-57e53278d5bf admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:51:59.988830 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:51:59.989849 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:51:59.990317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:51:59.990794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:51:59.991734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:51:59.993622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.007474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1394/2758] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:51:59 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:00.007474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.016458 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1365/2759] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:00.017399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.019783 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffa47f-22ff-496e-8336-064369160cc8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.028065 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.028804 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.029788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.029788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.030167 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796046-67c6-4169-af9d-901edc3cdca9 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.030413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.032577 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.034939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.035737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.036087 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.036431 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] PATH_INFO: `/v3/projects/dc4195c65d8f47bea66bee4969f6b869/users/8926d49eeec146f784c8f412680246e1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.053913 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4195c65d8f47bea66bee4969f6b869, user_id=8926d49eeec146f784c8f412680246e1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.056721 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.061298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1395/2760] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:00 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:00.061298 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.062231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:00.072786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1366/2761] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:00 2022] PUT /identity/v3/projects/dc4195c65d8f47bea66bee4969f6b869/users/8926d49eeec146f784c8f412680246e1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:00.073514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.101616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:00.127646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9abd19-691d-4fc3-af97-c8ff92e9eb85 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.138657 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892bf0-8496-4b99-8b10-0c98a73ec1a7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.143430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.144064 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.144350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.144626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.145333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.146937 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.157847 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1367/2762] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:00.158553 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.168530 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36af94-3b28-491c-bd82-ddee712b5e0e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.173430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.174025 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.174315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.174597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.175316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.176973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.181600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.182244 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.182523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.182801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.187212 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1368/2763] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:00.190708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.198214 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aceb506-b0e8-450b-9709-3660556dae09 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.203137 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.203923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.204209 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.204482 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.205182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.206870 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.220594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1369/2764] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:00.221712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.233671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5a4ad-1db1-4afe-b57b-a643793a8707 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.238444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.239117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.239427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.239724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] PATH_INFO: `/v3/projects/dc4195c65d8f47bea66bee4969f6b869/users/8926d49eeec146f784c8f412680246e1/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.241793 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4195c65d8f47bea66bee4969f6b869, user_id=8926d49eeec146f784c8f412680246e1, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.244581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.247193 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.248751 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd775-d88e-4a80-934e-8666621054a4 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.253682 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:00.255630 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1370/2765] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:00 2022] PUT /identity/v3/projects/dc4195c65d8f47bea66bee4969f6b869/users/8926d49eeec146f784c8f412680246e1/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:00.266202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.266554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1396/2766] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:00.267911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.267911 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.268154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.301050 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] MFA Rules not processed for user `8926d49eeec146f784c8f412680246e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:00.302620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:00.332420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdfeea-7fb3-4f96-b8c7-3a0a1d2bf5ef admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.337485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.338233 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.338528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.338808 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] PATH_INFO: `/v3/projects/9c5f80f4ad6c4c73b40b9e03b61a435b/users/5c03d347f4984936aab618bec89e455a/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.357432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5f80f4ad6c4c73b40b9e03b61a435b, user_id=5c03d347f4984936aab618bec89e455a, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.360676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de2b5f-4c84-4d03-898c-0061b2830259 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.377077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1371/2767] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:00 2022] PUT /identity/v3/projects/9c5f80f4ad6c4c73b40b9e03b61a435b/users/5c03d347f4984936aab618bec89e455a/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:00.385579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1397/2768] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:00.390201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.390487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.390761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.396932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.398819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:00.421388 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] MFA Rules not processed for user `5c03d347f4984936aab618bec89e455a`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:00.422663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:00.485583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82500545-3bf7-47f0-b3ff-29ec6053aa0c None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.499417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:00.507602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1372/2769] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:00.547085 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:00.558975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.559657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.559938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.560578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.613947 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603481ed-6989-49be-9767-e4038f1824e3 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:00.617936 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:00.618585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:00.618864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:00.619138 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:00.620124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=100 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:00.629107 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.630595 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.636718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:00.638189 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47f374-47ee-46b2-b877-91233f0e5d89 service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:00.640787 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1373/2770] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:52:00.649456 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1398/2771] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:52:00.943142 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:01.025049 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47964ad-3b9c-4290-b4dd-8de67b4e61c2 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:01.029694 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:01.030350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.030635 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.030912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] PATH_INFO: `/v3/users/89b64b3b15f8421fa9b4cd2f383a6667` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.032116 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b64b3b15f8421fa9b4cd2f383a6667)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:01.034104 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:01.088250 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b64b3b15f8421fa9b4cd2f383a6667'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.098712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b64b3b15f8421fa9b4cd2f383a6667'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.099730 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b64b3b15f8421fa9b4cd2f383a6667'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.111185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b64b3b15f8421fa9b4cd2f383a6667'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.123943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b64b3b15f8421fa9b4cd2f383a6667'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.130266 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1374/2772] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:00 2022] DELETE /identity/v3/users/89b64b3b15f8421fa9b4cd2f383a6667 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:01.134869 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.135386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.135639 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.155458 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:01.156833 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:01.223170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1399/2773] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:01.234366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:01.235916 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:01.261711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:01.306314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74b53-a54b-4e71-9588-c93b78bfcb05 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:01.310125 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:01.310843 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.311133 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.311474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.322181 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:01.323674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:01.333764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1375/2774] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:01.634614 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:01.636187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:01.648964 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6bb6-a7c5-498b-8b44-bb4c60fa24aa None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:01.655386 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:01.656063 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.656347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.656621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] PATH_INFO: `/v3/projects/91eda29288aa48ee9a5bcbfe18d30683` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.657922 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=91eda29288aa48ee9a5bcbfe18d30683)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:01.659961 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:01.713254 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91eda29288aa48ee9a5bcbfe18d30683', 'request_id': 'req-5c0db891-35d6-429c-8af2-75404e50cfbc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.721190 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91eda29288aa48ee9a5bcbfe18d30683', 'request_id': 'req-5c0db891-35d6-429c-8af2-75404e50cfbc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.727261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91eda29288aa48ee9a5bcbfe18d30683', 'request_id': 'req-5c0db891-35d6-429c-8af2-75404e50cfbc'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.742465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] The token cache is being invalidate because project 91eda29288aa48ee9a5bcbfe18d30683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:01.742867 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.743668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-5c0db891-35d6-429c-8af2-75404e50cfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.745477 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1400/2775] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:01 2022] DELETE /identity/v3/projects/91eda29288aa48ee9a5bcbfe18d30683 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:01.749920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:01.759931 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302a1bd-8fde-48ad-9c72-45188100b2a2 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:01.824833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:01.825461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.825828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.826337 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] PATH_INFO: `/v3/users/8926d49eeec146f784c8f412680246e1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.828436 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8926d49eeec146f784c8f412680246e1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:01.830999 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:01.843142 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c8184-fa2c-41c7-8c5f-2373ee6f7312 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:01.843480 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c8184-fa2c-41c7-8c5f-2373ee6f7312 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:01.843761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c8184-fa2c-41c7-8c5f-2373ee6f7312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:01.864424 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-ac9c8184-fa2c-41c7-8c5f-2373ee6f7312 None None] MFA Rules not processed for user `5f96ea7de0d74d2393afd458cb6ff74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:01.865726 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-ac9c8184-fa2c-41c7-8c5f-2373ee6f7312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:01.885057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8926d49eeec146f784c8f412680246e1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.895115 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8926d49eeec146f784c8f412680246e1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.897005 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8926d49eeec146f784c8f412680246e1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.908909 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8926d49eeec146f784c8f412680246e1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.927204 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8926d49eeec146f784c8f412680246e1'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:01.938074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1376/2776] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:01 2022] DELETE /identity/v3/users/8926d49eeec146f784c8f412680246e1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:01.942609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1401/2777] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:02.373731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.375825 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:02.427211 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:02.448140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc02845-bad5-4452-af61-f7031e651080 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.452991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.453655 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.453956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.454216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] PATH_INFO: `/v3/projects/dc4195c65d8f47bea66bee4969f6b869` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.455408 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4195c65d8f47bea66bee4969f6b869)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.457378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.512928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4195c65d8f47bea66bee4969f6b869', 'request_id': 'req-8733eef0-5565-4e4d-8429-a5d2edd2c235'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:02.519590 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4195c65d8f47bea66bee4969f6b869', 'request_id': 'req-8733eef0-5565-4e4d-8429-a5d2edd2c235'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:02.525647 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4195c65d8f47bea66bee4969f6b869', 'request_id': 'req-8733eef0-5565-4e4d-8429-a5d2edd2c235'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:02.545069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] The token cache is being invalidate because project dc4195c65d8f47bea66bee4969f6b869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:02.545508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:02.546120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8733eef0-5565-4e4d-8429-a5d2edd2c235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:02.547794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1377/2778] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:02 2022] DELETE /identity/v3/projects/dc4195c65d8f47bea66bee4969f6b869 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:02.552813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.553304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.553419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.573759 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:02.575045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:02.589421 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:02.650875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1402/2779] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:02.659076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.659340 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.659716 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.681861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:02.683075 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:02.691925 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1378/2780] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:02.696029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.706591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f5599-0c6d-4ac3-9656-c8db50f32ab4 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.712344 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.713044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.713326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.713602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.714308 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:52:02.714609 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.716248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.729269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1403/2781] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:52:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:52:02.733521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.744162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725291f1-8823-4972-9e94-ba7327bc379c None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.749363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.750060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.750402 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.750738 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.751514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.753461 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.784334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1379/2782] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:02 2022] POST /identity/v3/projects => generated 380 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:02.788983 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.800535 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edb77-ccb2-4edc-a28e-ecdc0f0ef4d2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.864829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.865692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.866423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.866423 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.866815 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.868904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.894236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1404/2783] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:02 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:02.898448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.910742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6ae5-be5a-41d0-b49b-4d1a1bfd073d admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.916641 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.917318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.917581 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.917853 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.918943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.921054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.932315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1380/2784] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:02 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:02.936729 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.946982 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddf4b-a72f-48ba-970e-1087dc20f2cf admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.951951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.952608 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.952859 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.953130 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:02.953829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:02.955472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:02.966985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1405/2785] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:02.971416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:02.982779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085253-59bb-477f-8c57-8b152e9b5f0c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:02.988356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:02.989082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:02.989361 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:02.989634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] PATH_INFO: `/v3/projects/68dedb9cf1264b3da44e25426b05cb1b/users/dd8b416692334ba0a726ee5bb2215c67/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.006039 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dedb9cf1264b3da44e25426b05cb1b, user_id=dd8b416692334ba0a726ee5bb2215c67, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.009577 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab022cf0-ff52-4563-a19f-848d66f13770 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.027985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1381/2786] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:02 2022] PUT /identity/v3/projects/68dedb9cf1264b3da44e25426b05cb1b/users/dd8b416692334ba0a726ee5bb2215c67/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:03.070657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.072921 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.088110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3195-68b1-4713-aff8-3a4c594c0233 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.100084 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.100332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.100620 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.129255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] MFA Rules not processed for user `dd8b416692334ba0a726ee5bb2215c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:03.130424 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.151544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.152217 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.152495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.152773 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] PATH_INFO: `/v3/users/e6460857026145b7aacaa00e97f20471` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.154049 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6460857026145b7aacaa00e97f20471)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.156198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.186530 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:03.195782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:03.203877 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1382/2787] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:03.208086 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.209578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6460857026145b7aacaa00e97f20471'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:03.210259 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6460857026145b7aacaa00e97f20471'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:03.210868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6460857026145b7aacaa00e97f20471'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:03.219341 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf3ce-1541-4c1f-a534-5bd6b0b831f4 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.220122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6460857026145b7aacaa00e97f20471'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:03.224910 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.225566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.225865 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.226143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.226811 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.228356 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-6eda79d5-60fd-4f72-a06d-7e0cffd89216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6460857026145b7aacaa00e97f20471'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:03.228809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.247956 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1406/2788] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:03 2022] DELETE /identity/v3/users/e6460857026145b7aacaa00e97f20471 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:03.252942 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.253224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.253495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.261527 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1383/2789] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:03 2022] POST /identity/v3/projects => generated 378 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:52:03.262585 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.264676 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.274422 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:03.275938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.333253 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79646-1100-4b5d-8821-de28adeb7ad6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.338782 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1495-888e-4877-b036-b3988827311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.339444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1495-888e-4877-b036-b3988827311e admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.339729 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1495-888e-4877-b036-b3988827311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.340054 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1495-888e-4877-b036-b3988827311e admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.340779 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1495-888e-4877-b036-b3988827311e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.342864 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1495-888e-4877-b036-b3988827311e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.344340 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1407/2790] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:03.354436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.355900 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.369459 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1384/2791] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:03 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:52:03.370508 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1495-888e-4877-b036-b3988827311e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.380128 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1495-888e-4877-b036-b3988827311e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.385259 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.386242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.386627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.387009 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.388414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.390682 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.401731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1385/2792] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:03 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:03.405882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.415813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba6ab-6d9b-43d8-9121-aff8b5bb55da None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.415995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541247-dadc-4628-acd6-15047c67ad11 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.419326 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.421037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.421037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.421037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.421955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.422686 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.422914 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.423196 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] PATH_INFO: `/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33/users/ba6487fa846d4b6f9d52447c356b1b75/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.430191 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.431673 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.438563 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6114bd5cd1452ca31ba1b64d16bc33, user_id=ba6487fa846d4b6f9d52447c356b1b75, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.441258 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.441699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1408/2793] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:52:03.455060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1386/2794] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:03 2022] PUT /identity/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33/users/ba6487fa846d4b6f9d52447c356b1b75/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:52:03.459106 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.468930 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a89f-aa53-42f0-8634-d4fbf8a916d9 service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.517270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:03.530837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.531494 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.531774 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.532045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.532745 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.534388 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc4e95-cc8a-491b-807b-07a652b9ca0c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.547599 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1409/2795] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:03 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:03.548944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.559638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf4fb-f80e-44a1-b364-b61f2b583ab7 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.564665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.565343 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.566094 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.566376 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] PATH_INFO: `/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33/users/ba6487fa846d4b6f9d52447c356b1b75/roles/e5925905b2aa4220ba3cded1ac5f08ba` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.568403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6114bd5cd1452ca31ba1b64d16bc33, user_id=ba6487fa846d4b6f9d52447c356b1b75, role_id=e5925905b2aa4220ba3cded1ac5f08ba)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.571033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.593987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1387/2796] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:03 2022] PUT /identity/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33/users/ba6487fa846d4b6f9d52447c356b1b75/roles/e5925905b2aa4220ba3cded1ac5f08ba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:03.595061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.595061 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.595571 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.624133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] MFA Rules not processed for user `ba6487fa846d4b6f9d52447c356b1b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:03.625341 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.700039 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1410/2797] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:03.712756 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:03.715386 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:03.784708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bda611-366b-4990-8a40-a154e7cfeb52 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:03.788554 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:03.789279 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:03.789634 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:03.789981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:03.800912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:03.802519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:03.813666 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1388/2798] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:04.023854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:04.025638 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:04.105070 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53d11-b3a7-4961-b6aa-fc27b1764351 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:04.110671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:04.111332 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:04.111646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:04.111926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] PATH_INFO: `/v3/projects/f73c735d92304329b9aab045d0f77f03` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:04.113104 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73c735d92304329b9aab045d0f77f03)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:04.115071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:04.166129 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73c735d92304329b9aab045d0f77f03', 'request_id': 'req-06b04aaa-6400-4f7e-934d-062c746879ae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.173814 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73c735d92304329b9aab045d0f77f03', 'request_id': 'req-06b04aaa-6400-4f7e-934d-062c746879ae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.180272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73c735d92304329b9aab045d0f77f03', 'request_id': 'req-06b04aaa-6400-4f7e-934d-062c746879ae'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.189897 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:04.194985 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] The token cache is being invalidate because project f73c735d92304329b9aab045d0f77f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:04.195442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.197282 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-06b04aaa-6400-4f7e-934d-062c746879ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.200732 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1411/2799] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:04 2022] DELETE /identity/v3/projects/f73c735d92304329b9aab045d0f77f03 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:04.216488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:04.228076 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8f03-e35c-47e4-afc7-63e39628a511 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:04.247755 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:04.294015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:04.295186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:04.295637 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:04.295923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] PATH_INFO: `/v3/users/dd8b416692334ba0a726ee5bb2215c67` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:04.297224 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8b416692334ba0a726ee5bb2215c67)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:04.299202 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:04.357957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8b416692334ba0a726ee5bb2215c67'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.365158 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8b416692334ba0a726ee5bb2215c67'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.365878 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8b416692334ba0a726ee5bb2215c67'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.374813 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8b416692334ba0a726ee5bb2215c67'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.388486 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8b416692334ba0a726ee5bb2215c67'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.395567 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1389/2800] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:04 2022] DELETE /identity/v3/users/dd8b416692334ba0a726ee5bb2215c67 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:04.400988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:04.401267 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:04.401553 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:04.422470 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:04.423775 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:04.491444 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1412/2801] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:04.502531 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:04.504363 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:04.573078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32550e9a-a947-4ac5-85db-14ddab4a3aa5 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:04.578532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:04.579166 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:04.579481 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:04.579762 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:04.590047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:04.591616 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:04.601858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1390/2802] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:04.877864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:04.879435 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:04.894650 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad288f1-8b13-4d42-a641-637bb321969e None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:04.908474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:04.909150 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:04.909434 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:04.909710 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] PATH_INFO: `/v3/projects/68dedb9cf1264b3da44e25426b05cb1b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:04.910904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dedb9cf1264b3da44e25426b05cb1b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:04.912949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:04.964493 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dedb9cf1264b3da44e25426b05cb1b', 'request_id': 'req-c15b976e-59ef-4c8b-b919-509179a5b6fb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.970940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dedb9cf1264b3da44e25426b05cb1b', 'request_id': 'req-c15b976e-59ef-4c8b-b919-509179a5b6fb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.976875 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dedb9cf1264b3da44e25426b05cb1b', 'request_id': 'req-c15b976e-59ef-4c8b-b919-509179a5b6fb'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.991081 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] The token cache is being invalidate because project 68dedb9cf1264b3da44e25426b05cb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:04.991393 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.992038 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:04.993573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1413/2803] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:04 2022] DELETE /identity/v3/projects/68dedb9cf1264b3da44e25426b05cb1b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:04.997712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:05.008488 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd2a3-fe52-425e-b108-074a435029fd service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:05.052698 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:05.073761 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:05.074419 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.074706 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.074985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] PATH_INFO: `/v3/users/ba6487fa846d4b6f9d52447c356b1b75` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.076444 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6487fa846d4b6f9d52447c356b1b75)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:05.079802 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:05.139807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6487fa846d4b6f9d52447c356b1b75'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.147602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6487fa846d4b6f9d52447c356b1b75'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.148557 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6487fa846d4b6f9d52447c356b1b75'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.157179 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6487fa846d4b6f9d52447c356b1b75'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.170918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-32cc80a6-be93-45bc-9409-c0de89954d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6487fa846d4b6f9d52447c356b1b75'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.176919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1391/2804] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:04 2022] DELETE /identity/v3/users/ba6487fa846d4b6f9d52447c356b1b75 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:52:05.463709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:05.465465 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:05.491796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b976e-59ef-4c8b-b919-509179a5b6fb admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:05.553439 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:05.554228 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.554610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.555015 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] PATH_INFO: `/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.556398 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6114bd5cd1452ca31ba1b64d16bc33)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:05.558772 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:05.599446 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:05.622596 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6114bd5cd1452ca31ba1b64d16bc33', 'request_id': 'req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.629462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6114bd5cd1452ca31ba1b64d16bc33', 'request_id': 'req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.636377 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6114bd5cd1452ca31ba1b64d16bc33', 'request_id': 'req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.662064 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] The token cache is being invalidate because project 9b6114bd5cd1452ca31ba1b64d16bc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:05.662575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.663399 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-15b75f3a-3a15-4bb0-8233-e22b3d4785d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:05.665110 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1414/2805] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:05 2022] DELETE /identity/v3/projects/9b6114bd5cd1452ca31ba1b64d16bc33 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:05.671656 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.672631 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.672789 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.701489 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:05.702718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:05.811403 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1392/2806] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:05.819055 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369dd48-7575-4727-811e-029a39956a4d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.819349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369dd48-7575-4727-811e-029a39956a4d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.819654 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369dd48-7575-4727-811e-029a39956a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.842210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9369dd48-7575-4727-811e-029a39956a4d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:05.843709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9369dd48-7575-4727-811e-029a39956a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:05.851926 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1415/2807] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:05.857165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:05.867592 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc2f0-d499-4fd4-9b19-4faf4268185a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:05.872831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:05.873480 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.873750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.874034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.874746 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:52:05.875091 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:05.876862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:05.891396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1393/2808] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:52:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 20:52:05.895813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369dd48-7575-4727-811e-029a39956a4d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:05.906155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369dd48-7575-4727-811e-029a39956a4d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:05.911601 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:05.912413 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:05.912877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:05.913272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:05.914575 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:05.916659 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:05.963757 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1416/2809] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:05 2022] POST /identity/v3/projects => generated 364 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:05.963991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:05.978298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a52e9b-6a36-4f65-b3a5-17cc77f28a86 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:06.039072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:06.054513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:06.055255 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.056048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.056048 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.056833 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:06.058966 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:06.086980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1394/2810] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:05 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:06.090781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:06.102450 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da06-906f-454d-afe7-2f8bce213301 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:06.107949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:06.108628 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.109194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.109472 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.110525 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:06.116487 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:06.123960 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1417/2811] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:06 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:06.127652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:06.140338 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4b9b8-cc27-4e9a-a95b-08cb60a90809 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:06.145362 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:06.146003 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.146292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.146575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.147770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:06.149006 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e4ff0-b070-4039-80d3-d05df9f809bf admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:06.162316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1395/2812] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:06 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:06.166709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:06.178155 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a547-48bf-44b6-a7d2-15660b1267c8 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:06.183482 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:06.184404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.184404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.184670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] PATH_INFO: `/v3/projects/dcb8c7cfb5cb4aa19fed7bb4cb543b20/users/83ba17fe694a48ea95fb92b2348e732b/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.201622 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb8c7cfb5cb4aa19fed7bb4cb543b20, user_id=83ba17fe694a48ea95fb92b2348e732b, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:06.205045 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:06.223089 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1418/2813] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:06 2022] PUT /identity/v3/projects/dcb8c7cfb5cb4aa19fed7bb4cb543b20/users/83ba17fe694a48ea95fb92b2348e732b/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:06.240448 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.240701 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.240983 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.273314 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] MFA Rules not processed for user `83ba17fe694a48ea95fb92b2348e732b`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:06.275068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:06.342632 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1396/2814] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:06.354066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:06.355813 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:06.418353 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4035c-2847-404c-a63c-1c3d5ca9d985 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:06.422299 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:06.422975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:06.423260 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:06.423567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:06.433771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:06.435699 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38f44-2653-4e41-9433-90115d675d6f service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:06.445547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1419/2815] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:08.297988 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:08.299526 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:08.375277 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f91d-48d0-497f-91c4-cb1b7883519e None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:08.381354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:08.382057 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:08.382347 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:08.382626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] PATH_INFO: `/v3/users/5c03d347f4984936aab618bec89e455a` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:08.384389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c03d347f4984936aab618bec89e455a)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:08.385926 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:08.441232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c03d347f4984936aab618bec89e455a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:08.448471 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c03d347f4984936aab618bec89e455a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:08.449203 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c03d347f4984936aab618bec89e455a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:08.452042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:08.458751 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c03d347f4984936aab618bec89e455a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:08.471961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c03d347f4984936aab618bec89e455a'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:08.478052 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1397/2816] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:08 2022] DELETE /identity/v3/users/5c03d347f4984936aab618bec89e455a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:08.482453 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:08.482965 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:08.483051 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:08.503652 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:08.504902 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:08.555663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:08.572794 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1420/2817] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:08.583570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:08.584806 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:08.646685 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0048118-b5df-4293-92cf-51bf14ea54c3 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:08.650661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:08.651973 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:08.652247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:08.652513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:08.662823 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:08.664307 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c83f6-5807-484c-91e7-ee2a114e861a service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:08.677543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1398/2818] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:08.996428 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:08.997621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.012753 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120407f-d6ce-445a-980b-c50405c20e6d None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.018304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.018966 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.019251 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.019612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] PATH_INFO: `/v3/projects/9c5f80f4ad6c4c73b40b9e03b61a435b` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.020793 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5f80f4ad6c4c73b40b9e03b61a435b)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.022728 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.074538 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5f80f4ad6c4c73b40b9e03b61a435b', 'request_id': 'req-aabaf01f-3cb3-483b-8034-8b73d7b06059'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:09.080986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5f80f4ad6c4c73b40b9e03b61a435b', 'request_id': 'req-aabaf01f-3cb3-483b-8034-8b73d7b06059'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:09.086738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5f80f4ad6c4c73b40b9e03b61a435b', 'request_id': 'req-aabaf01f-3cb3-483b-8034-8b73d7b06059'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:09.100510 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] The token cache is being invalidate because project 9c5f80f4ad6c4c73b40b9e03b61a435b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:09.100802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:09.101432 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-aabaf01f-3cb3-483b-8034-8b73d7b06059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:09.102988 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1421/2819] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:08 2022] DELETE /identity/v3/projects/9c5f80f4ad6c4c73b40b9e03b61a435b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:09.108232 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.108518 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.108792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.130777 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:09.132015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.213720 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1399/2820] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:09.225938 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.226324 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.226734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.249437 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:09.250635 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.259548 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1422/2821] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:09.264484 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.275174 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2121-bd01-4a67-97b7-9868de55fc66 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.281528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.282159 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.282442 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.282724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.283465 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:52:09.283781 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.285416 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.300111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1400/2822] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:52:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:52:09.304821 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.314686 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d777ca6-b65d-4e7a-87aa-a0b5015a1dc3 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.319811 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.320436 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.320720 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.321004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.321671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.323630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.353736 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1423/2823] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:09 2022] POST /identity/v3/projects => generated 376 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:09.357955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.368547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd600-2d7b-4e74-a5e4-70f3f59e916e admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.434475 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.435597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.435933 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.436193 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.436892 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.438929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.456331 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:09.468846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1401/2824] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:09 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:09.473179 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.484100 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191347-b510-4459-b900-110dcbb17161 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.489223 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.489986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.490273 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.490549 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.491265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.492906 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.508026 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1424/2825] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:09.509737 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.521528 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114584-0ea9-4387-9193-4daf6fb6b7d9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.527845 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.528579 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.529066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.529477 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.530440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.532351 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.547185 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1402/2826] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:09 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:09.551968 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.563192 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c5e9-5b29-4fba-ad6f-94d47d5a1bdd admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.568297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.568984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.569279 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.569550 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] PATH_INFO: `/v3/projects/7047309bcb2b4e99b5afc3dbebfb8f84/users/3973a7a0a526404280f4502757782784/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.584493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.586342 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.591612 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7047309bcb2b4e99b5afc3dbebfb8f84, user_id=3973a7a0a526404280f4502757782784, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.594412 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c74ce-388d-4056-8596-9b7c6190b636 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.608841 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1425/2827] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:09 2022] PUT /identity/v3/projects/7047309bcb2b4e99b5afc3dbebfb8f84/users/3973a7a0a526404280f4502757782784/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:09.619232 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.619567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.619851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.648093 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] MFA Rules not processed for user `3973a7a0a526404280f4502757782784`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:09.649455 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.695510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe645b-221a-47ff-a51c-88fe66f84754 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.729718 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1426/2828] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:52:09.737663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:09.739485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.744984 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:09.766033 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.766707 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.766994 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.767271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.769378 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:09.782470 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.784152 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.794525 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1403/2829] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:52:09.801359 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d61a6-7fe0-40c9-a9f7-e228499f6e1f None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:09.805396 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:09.806037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:09.806336 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:09.806610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:09.816125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:09.817655 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0d567-75c0-46c9-adf4-c492935e50cc service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:09.830397 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1427/2830] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:52:12.935507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:12.998831 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=100 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:13.003681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4a34-305f-47b0-a599-c0c177a5ec2e service placement] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.009034 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:13.009687 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.009969 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.010242 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] PATH_INFO: `/v3/users/3973a7a0a526404280f4502757782784` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.011520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3973a7a0a526404280f4502757782784)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:13.013578 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:13.067792 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3973a7a0a526404280f4502757782784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.074691 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3973a7a0a526404280f4502757782784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.075422 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3973a7a0a526404280f4502757782784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.083265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3973a7a0a526404280f4502757782784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.095661 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3973a7a0a526404280f4502757782784'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.101742 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1404/2831] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:12 2022] DELETE /identity/v3/users/3973a7a0a526404280f4502757782784 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:13.106567 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.107163 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.107495 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.128286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:13.129544 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:13.200014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1428/2832] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:13.210957 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:13.212699 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:13.272068 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3edb4-c03e-433e-b359-baed016d678a admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.276239 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:13.276862 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.277144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.277417 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.287510 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:13.288991 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e544-4549-410f-a323-cc44ec26b11f service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:13.299912 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1405/2833] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:13.606088 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:13.607792 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:13.621539 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bb55-ed46-442e-b340-1a3bd570b2f5 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.627976 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:13.628636 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.628914 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.629188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] PATH_INFO: `/v3/projects/7047309bcb2b4e99b5afc3dbebfb8f84` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.630354 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7047309bcb2b4e99b5afc3dbebfb8f84)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:13.632555 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:13.683301 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7047309bcb2b4e99b5afc3dbebfb8f84', 'request_id': 'req-473eaa00-87b7-4f42-adc8-630a820bbf66'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.690197 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7047309bcb2b4e99b5afc3dbebfb8f84', 'request_id': 'req-473eaa00-87b7-4f42-adc8-630a820bbf66'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.696578 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7047309bcb2b4e99b5afc3dbebfb8f84', 'request_id': 'req-473eaa00-87b7-4f42-adc8-630a820bbf66'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.711670 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] The token cache is being invalidate because project 7047309bcb2b4e99b5afc3dbebfb8f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:13.711970 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.712693 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-473eaa00-87b7-4f42-adc8-630a820bbf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:13.714328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1429/2834] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:13 2022] DELETE /identity/v3/projects/7047309bcb2b4e99b5afc3dbebfb8f84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:13.719602 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d6571-236e-451d-9b48-30659233839d None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.719921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d6571-236e-451d-9b48-30659233839d None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.720290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d6571-236e-451d-9b48-30659233839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.742768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-b07d6571-236e-451d-9b48-30659233839d None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:13.744014 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-b07d6571-236e-451d-9b48-30659233839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:13.809404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1406/2835] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:13.818466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.818737 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.819016 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.841224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:13.842967 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:13.851583 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1430/2836] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:13.855961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d6571-236e-451d-9b48-30659233839d None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:13.866593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d6571-236e-451d-9b48-30659233839d None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.871697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:13.872786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.872786 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.873078 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.873809 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:52:13.874117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:13.875750 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:13.887704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1407/2837] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:52:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:52:13.892883 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:13.903392 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d975-40d9-4862-9b60-e48ce36d1755 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.909547 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:13.910171 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:13.910457 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:13.910738 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:13.911394 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:13.913416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:13.937973 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:13.950181 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1431/2838] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:13 2022] POST /identity/v3/projects => generated 370 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:13.951665 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:13.962945 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577557f-ecd1-4403-a0d3-4e41b6761968 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:13.967521 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:14.025265 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:14.025908 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.026194 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.026472 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.027165 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:14.029298 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:14.053790 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1408/2839] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:13 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:14.057870 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:14.069554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ae68-159f-4e77-ba4d-a398d6739ac0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:14.074934 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:14.076122 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.076416 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.076695 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.077414 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:14.079573 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:14.091426 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1432/2840] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:14 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 20:52:14.096547 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:14.114369 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457eb-e7b2-48e1-b1a9-882019c4d5f0 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:14.123384 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:14.124082 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.124414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.124886 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.125838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:14.127519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81726ab-722b-4eb4-821a-485daefb3d51 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:14.140315 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1409/2841] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:14 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:14.145119 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:14.156913 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d0f2-9fad-491d-9326-c5711fd53e89 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:14.162014 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:14.162690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.162978 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.163291 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] PATH_INFO: `/v3/projects/23f5d515af7e4fb59ad8140f3d6434f3/users/b1837afc03554deb8bd2db1506b9e1f8/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.178527 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5d515af7e4fb59ad8140f3d6434f3, user_id=b1837afc03554deb8bd2db1506b9e1f8, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:14.181272 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:14.198262 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1433/2842] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:14 2022] PUT /identity/v3/projects/23f5d515af7e4fb59ad8140f3d6434f3/users/b1837afc03554deb8bd2db1506b9e1f8/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:14.209058 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.209356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.209644 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.251117 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] MFA Rules not processed for user `b1837afc03554deb8bd2db1506b9e1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:14.252404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:14.321674 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1410/2843] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:14.335532 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:14.337492 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:14.397846 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b17d9-5b36-4321-a622-c0d16896104b admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:14.402700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1522c66319745588bc60119696076db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:14.403328 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:14.403690 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:14.403992 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:14.417838 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:14.420497 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accad1e-b955-42ea-9c91-4fefa1fd9d44 service glance] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:14.429949 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1434/2844] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:24.317998 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:24.425485 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:53.044919 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:53.118275 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36400b-f4fa-46c8-9e81-4d792b6e3192 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:53.123533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:53.124198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:53.124487 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:53.124770 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] PATH_INFO: `/v3/users/b1837afc03554deb8bd2db1506b9e1f8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:53.125995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1837afc03554deb8bd2db1506b9e1f8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:53.127959 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:53.176247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1837afc03554deb8bd2db1506b9e1f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.184492 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1837afc03554deb8bd2db1506b9e1f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.185192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1837afc03554deb8bd2db1506b9e1f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.194623 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1837afc03554deb8bd2db1506b9e1f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.208273 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1837afc03554deb8bd2db1506b9e1f8'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.214715 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1411/2845] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:53 2022] DELETE /identity/v3/users/b1837afc03554deb8bd2db1506b9e1f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:53.219297 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a327-8420-4012-9057-f39129682a48 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:53.219842 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a327-8420-4012-9057-f39129682a48 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:53.219952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a327-8420-4012-9057-f39129682a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:53.240098 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-8f81a327-8420-4012-9057-f39129682a48 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:53.241678 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8f81a327-8420-4012-9057-f39129682a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:53.305975 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1435/2846] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:53.316799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:53.319097 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:53.421452 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d445b37-1b61-42db-b905-02ae0c6886e6 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:53.425144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:53.425764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:53.426042 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:53.426366 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:53.435882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:53.437350 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa32ab-0b45-4aca-974b-0517b4a5210d service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:53.446838 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1412/2847] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:53.733159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81a327-8420-4012-9057-f39129682a48 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:53.734621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8f81a327-8420-4012-9057-f39129682a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:53.746761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81a327-8420-4012-9057-f39129682a48 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:53.751958 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:53.752621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:53.752896 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:53.753166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] PATH_INFO: `/v3/projects/23f5d515af7e4fb59ad8140f3d6434f3` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:53.754333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f5d515af7e4fb59ad8140f3d6434f3)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:53.756357 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:53.805579 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f5d515af7e4fb59ad8140f3d6434f3', 'request_id': 'req-73062abd-f49e-449c-a4c7-91fc94d7da35'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.812269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f5d515af7e4fb59ad8140f3d6434f3', 'request_id': 'req-73062abd-f49e-449c-a4c7-91fc94d7da35'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.817895 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f5d515af7e4fb59ad8140f3d6434f3', 'request_id': 'req-73062abd-f49e-449c-a4c7-91fc94d7da35'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.831864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] The token cache is being invalidate because project 23f5d515af7e4fb59ad8140f3d6434f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:53.832237 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.832889 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-73062abd-f49e-449c-a4c7-91fc94d7da35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:53.834512 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1436/2848] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:53 2022] DELETE /identity/v3/projects/23f5d515af7e4fb59ad8140f3d6434f3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:52:53.840399 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:53.840689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:53.840962 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:53.848532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:53.862628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:53.863939 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:53.938507 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1413/2849] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:54.029886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.029886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.029886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.050152 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:54.051454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:54.062002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1437/2850] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:54.067432 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.082162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fee65-7a19-47dc-93bc-3c248956c248 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.090700 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.091626 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.091940 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.092216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.093069 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:52:54.093374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.094985 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.107411 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1414/2851] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:52:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:52:54.112709 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.125198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a0714-123b-4175-a294-afb8d448b7d8 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.130863 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.131516 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.131796 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.132066 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.132733 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.134647 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.164829 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1438/2852] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:52:54 2022] POST /identity/v3/projects => generated 372 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:54.170079 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.180929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5165e5-faab-4bf3-a9f6-214b3dac5ea9 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.240008 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.240638 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.240920 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.241192 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] PATH_INFO: `/v3/users` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.241861 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.243944 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.268815 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1415/2853] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:52:54 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:52:54.273042 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.284722 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a0f25-c2f6-4ac1-9b9a-2314aed4d5e3 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.290270 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.290986 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.291347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.291734 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.292441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.294054 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.304210 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1439/2854] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:54 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:54.308980 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.319122 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43be48-6cb5-4130-8717-2fd1940f767b admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.324807 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.325420 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.325704 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.325981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.326663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.328303 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3a83-8a3d-443f-ae08-93c5d87fc5ca admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.339509 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1416/2855] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:52:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:52:54.343742 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.354506 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd393b42-96bf-48ac-95fc-b1cb97171f23 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.360462 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.361125 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.361405 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.361679 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] PATH_INFO: `/v3/projects/fe9317de6b294296bfe8f8d894634fd6/users/4e965f865a2b45719ef8e1147b5b9544/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.377102 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9317de6b294296bfe8f8d894634fd6, user_id=4e965f865a2b45719ef8e1147b5b9544, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.379824 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.394630 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1440/2856] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:52:54 2022] PUT /identity/v3/projects/fe9317de6b294296bfe8f8d894634fd6/users/4e965f865a2b45719ef8e1147b5b9544/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:54.405433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.405760 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.406015 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.434663 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] MFA Rules not processed for user `4e965f865a2b45719ef8e1147b5b9544`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:54.435960 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:54.502099 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:54.509943 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1417/2857] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:54.520265 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:54.521995 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:54.546851 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:54.611376 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93a0df-eb0b-4cb5-b969-9477112f6ada admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:54.615247 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:54.615904 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:54.616187 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:54.616467 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:54.626071 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:54.627562 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03ac2-be80-493f-ae01-676d0afb2fda service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:54.636864 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1441/2858] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:57.940218 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:57.941921 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:58.019519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63106dc4-3a62-4c57-8d74-419165da8061 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:58.024435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:58.025184 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:58.025619 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:58.026056 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] PATH_INFO: `/v3/users/83ba17fe694a48ea95fb92b2348e732b` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:58.027269 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ba17fe694a48ea95fb92b2348e732b)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:58.029226 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:58.077929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ba17fe694a48ea95fb92b2348e732b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.085071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ba17fe694a48ea95fb92b2348e732b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.085784 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ba17fe694a48ea95fb92b2348e732b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.094992 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ba17fe694a48ea95fb92b2348e732b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.108140 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ba17fe694a48ea95fb92b2348e732b'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.114157 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1418/2859] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:52:57 2022] DELETE /identity/v3/users/83ba17fe694a48ea95fb92b2348e732b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:52:58.118850 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:58.119459 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:58.119786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:58.140620 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:52:58.142263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:58.205484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1442/2860] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:52:58.216106 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:58.218335 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:58.283327 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecdb8-725e-4628-8778-460820ba9088 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:58.287294 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:58.287967 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:58.288252 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:58.288532 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:58.298535 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:58.300043 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:58.310332 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1419/2861] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:52:58.609095 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:52:58.610600 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:52:58.623755 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76283-c084-472e-a636-4c1e5e41da39 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:52:58.628566 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:52:58.629225 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:52:58.629508 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:52:58.629786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] PATH_INFO: `/v3/projects/dcb8c7cfb5cb4aa19fed7bb4cb543b20` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:52:58.630957 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb8c7cfb5cb4aa19fed7bb4cb543b20)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:52:58.633000 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:52:58.686162 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb8c7cfb5cb4aa19fed7bb4cb543b20', 'request_id': 'req-9e41b434-8d0c-4a93-a035-bd992fdb36e2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.692701 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb8c7cfb5cb4aa19fed7bb4cb543b20', 'request_id': 'req-9e41b434-8d0c-4a93-a035-bd992fdb36e2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.699044 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb8c7cfb5cb4aa19fed7bb4cb543b20', 'request_id': 'req-9e41b434-8d0c-4a93-a035-bd992fdb36e2'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.713517 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] The token cache is being invalidate because project dcb8c7cfb5cb4aa19fed7bb4cb543b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:52:58.713730 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.714474 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-9e41b434-8d0c-4a93-a035-bd992fdb36e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:52:58.716213 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1443/2862] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:52:58 2022] DELETE /identity/v3/projects/dcb8c7cfb5cb4aa19fed7bb4cb543b20 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:00.092318 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:00.093918 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:00.117398 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:00.156251 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed72-7568-4ca9-93a9-1f269622ae9b service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:00.210144 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:00.210778 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:00.211066 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:00.211345 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:00.213473 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:00.276450 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:00.277904 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:00.288031 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1420/2863] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:53:08.709879 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:10.283628 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=59 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:14.567886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:14.568438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:14.568438 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:14.589263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] MFA Rules not processed for user `9b5ea50e80674c9f96821af04540ba39`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:14.590580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:14.599073 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1444/2864] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:14.942618 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:14.944290 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:15.004653 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ffb8d-72fe-406f-baa4-242154eee750 service cinder] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:15.008503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:15.009112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:15.009433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:15.009708 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:15.011671 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:15.021429 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:15.022835 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ea90-4042-496f-af64-38aca9b132fa service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:15.031323 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1421/2865] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 20:53:16.534185 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:16.539781 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:16.624333 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090baf76-dda2-4112-b3f6-a24b46142a58 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:16.629419 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:16.630263 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:16.630854 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:16.631931 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] PATH_INFO: `/v3/users/4e965f865a2b45719ef8e1147b5b9544` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:16.632623 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e965f865a2b45719ef8e1147b5b9544)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:16.635766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:16.698111 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e965f865a2b45719ef8e1147b5b9544'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:16.698797 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e965f865a2b45719ef8e1147b5b9544'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:16.699610 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e965f865a2b45719ef8e1147b5b9544'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:16.724288 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e965f865a2b45719ef8e1147b5b9544'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:16.736200 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e965f865a2b45719ef8e1147b5b9544'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:16.759786 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1445/2866] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:53:16 2022] DELETE /identity/v3/users/4e965f865a2b45719ef8e1147b5b9544 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:16.764126 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:16.764611 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:16.764696 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:16.786649 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:16.789830 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:16.859077 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1422/2867] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:16.869276 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:16.870807 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:16.934442 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757144a-2025-4df0-8d5f-c40b65addfe0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:16.938304 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:16.939037 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:16.939404 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:16.939700 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:16.950268 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:16.951907 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4cc3e-55c5-4d8c-a168-45cc348f8a15 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:16.966837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1446/2868] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:53:17.385711 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.387270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:17.400758 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8ede-a68b-4e39-80a2-7f26df1c6328 None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.407502 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.408397 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.409292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.409292 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] PATH_INFO: `/v3/projects/fe9317de6b294296bfe8f8d894634fd6` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.410433 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9317de6b294296bfe8f8d894634fd6)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.412697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.477955 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9317de6b294296bfe8f8d894634fd6', 'request_id': 'req-c8f08715-6818-4ef3-849e-0e5a869fb425'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:17.486690 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9317de6b294296bfe8f8d894634fd6', 'request_id': 'req-c8f08715-6818-4ef3-849e-0e5a869fb425'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:17.494146 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9317de6b294296bfe8f8d894634fd6', 'request_id': 'req-c8f08715-6818-4ef3-849e-0e5a869fb425'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:17.511271 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] The token cache is being invalidate because project fe9317de6b294296bfe8f8d894634fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:53:17.511681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:17.512334 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c8f08715-6818-4ef3-849e-0e5a869fb425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:17.513848 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1423/2869] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:53:17 2022] DELETE /identity/v3/projects/fe9317de6b294296bfe8f8d894634fd6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:17.518746 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.519032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.519305 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.540932 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:17.542318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:17.554311 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:17.618798 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1447/2870] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 20:53:17.622513 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17964-f641-4537-adcb-a425d24175ff None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.622810 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17964-f641-4537-adcb-a425d24175ff None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.623098 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17964-f641-4537-adcb-a425d24175ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.647316 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-42e17964-f641-4537-adcb-a425d24175ff None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:17.648731 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-42e17964-f641-4537-adcb-a425d24175ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:17.660929 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1424/2871] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:17.662242 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.672903 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75ef6-ea99-4683-9efb-1f49e7b8fbdb None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.677866 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.678505 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.678860 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.679204 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.680951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 20:53:17.680951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.685085 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.704269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1448/2872] 10.222.0.100 () {58 vars in 1158 bytes} [Fri Aug 5 20:53:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 20:53:17.708514 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17964-f641-4537-adcb-a425d24175ff None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.719485 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17964-f641-4537-adcb-a425d24175ff None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.725035 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.726503 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.726890 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.727243 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.728110 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.730186 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.754681 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:17.766995 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1425/2873] 10.222.0.100 () {60 vars in 1158 bytes} [Fri Aug 5 20:53:17 2022] POST /identity/v3/projects => generated 398 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 20:53:17.771236 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.782602 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95362a-0e02-4b26-abc3-b0a68b3778a0 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.870248 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.871154 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.871466 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.871740 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.872580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.874915 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.904646 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1449/2874] 10.222.0.100 () {60 vars in 1149 bytes} [Fri Aug 5 20:53:17 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 20:53:17.908743 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.923201 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497bc9-c7f2-4230-b999-06fd456fbf26 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.928570 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.929210 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.929493 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.929768 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] PATH_INFO: `/v3/roles` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.930478 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.932356 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.944198 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1426/2875] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:53:17 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:53:17.948484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:17.966795 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e93e-8990-4c4f-887a-45de504aa6e5 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:17.969362 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:17.969469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:17.969692 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:17.970194 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:17.970658 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:17.972529 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafc293-37b2-4595-8faf-8734ead16ee1 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:17.986819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1450/2876] 10.222.0.100 () {58 vars in 1127 bytes} [Fri Aug 5 20:53:17 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 20:53:17.990981 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:18.003538 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed801-e9e6-4350-9660-96aba4b1371c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:18.009594 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:18.010288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:18.010576 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:18.010858 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] PATH_INFO: `/v3/projects/8178119ca5664a81afc6e46a7ab12209/users/ce70c30e22d34b33a358b66bd684896e/roles/f471e7fbe9e344549f74ea85c7fa0fe1` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:18.032143 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8178119ca5664a81afc6e46a7ab12209, user_id=ce70c30e22d34b33a358b66bd684896e, role_id=f471e7fbe9e344549f74ea85c7fa0fe1)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:18.035016 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:18.053183 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1427/2877] 10.222.0.100 () {60 vars in 1488 bytes} [Fri Aug 5 20:53:17 2022] PUT /identity/v3/projects/8178119ca5664a81afc6e46a7ab12209/users/ce70c30e22d34b33a358b66bd684896e/roles/f471e7fbe9e344549f74ea85c7fa0fe1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:18.064629 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:18.065047 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:18.065206 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:18.098877 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] MFA Rules not processed for user `ce70c30e22d34b33a358b66bd684896e`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:18.100269 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:18.182940 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1451/2878] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:18.194396 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:18.196254 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:18.257956 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20558f-d58b-40f1-b016-f8c54ec41953 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:18.262151 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:18.262801 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:18.263090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:18.263387 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:18.273112 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:18.274895 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbf30-30cc-4c9f-9b29-b4490502e7b3 service cinder] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:18.284990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1428/2879] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:53:28.180124 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:28.280718 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:28.743963 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:28.809417 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3962-e036-498d-b74d-5f7e71f867dc None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:28.814349 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:28.815002 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:28.815281 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:28.815580 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] PATH_INFO: `/v3/users/ce70c30e22d34b33a358b66bd684896e` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:28.816766 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce70c30e22d34b33a358b66bd684896e)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:28.818827 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:28.868029 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce70c30e22d34b33a358b66bd684896e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:28.868739 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce70c30e22d34b33a358b66bd684896e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:28.869346 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce70c30e22d34b33a358b66bd684896e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:28.877837 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce70c30e22d34b33a358b66bd684896e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:28.886222 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce70c30e22d34b33a358b66bd684896e'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:28.903788 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1452/2880] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:53:28 2022] DELETE /identity/v3/users/ce70c30e22d34b33a358b66bd684896e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:28.908506 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] REQUEST_METHOD: `POST` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:28.908794 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:28.909072 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:28.928697 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.auth.core [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] MFA Rules not processed for user `08fbb9e763104d83ac22d69bcd83fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:28.929923 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:28.995083 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1429/2881] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:29.006952 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:29.008478 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:29.069074 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c02668-5b06-462d-8cb0-4358ac7f856e admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:29.073286 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:29.073919 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:29.074199 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:29.074469 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:29.083803 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:29.085275 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694cca-142a-478b-9e3a-1de27352cc39 service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:29.095172 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1453/2882] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:53:29.383207 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:29.385321 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:29.398374 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e5e36-fb06-4e8d-abc5-65e9981a5f3a None None] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:29.403932 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:29.404593 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:29.404851 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:29.405162 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] PATH_INFO: `/v3/projects/8178119ca5664a81afc6e46a7ab12209` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:29.406382 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8178119ca5664a81afc6e46a7ab12209)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:29.408404 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:29.465322 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8178119ca5664a81afc6e46a7ab12209', 'request_id': 'req-8842cb1a-2704-4fbb-b8cf-086090c5780c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:29.474898 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8178119ca5664a81afc6e46a7ab12209', 'request_id': 'req-8842cb1a-2704-4fbb-b8cf-086090c5780c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:29.482090 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8178119ca5664a81afc6e46a7ab12209', 'request_id': 'req-8842cb1a-2704-4fbb-b8cf-086090c5780c'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:29.497153 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] The token cache is being invalidate because project 8178119ca5664a81afc6e46a7ab12209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:53:29.497451 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:29.498134 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:53:29.499903 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1430/2883] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:53:29 2022] DELETE /identity/v3/projects/8178119ca5664a81afc6e46a7ab12209 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:53:35.172032 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] REQUEST_METHOD: `POST` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:35.172868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:35.172868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:35.193554 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.auth.core [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] MFA Rules not processed for user `5f96ea7de0d74d2393afd458cb6ff74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 20:53:35.194801 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:35.212318 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:35.257743 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1454/2884] 10.222.0.100 () {58 vars in 963 bytes} [Fri Aug 5 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 20:53:36.204383 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:53:36.206414 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:36.270302 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cb1a-2704-4fbb-b8cf-086090c5780c admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:53:36.274354 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:53:36.274987 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:53:36.275270 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:53:36.275575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:53:36.277519 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:53:36.325672 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:36.352319 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:53:36.353873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:53:36.364359 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1431/2885] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:53:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:53:45.250785 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=15 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:46.359562 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=12 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:06.681959 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:54:06.683621 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:54:06.748208 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19333d97-1bb5-4a28-b1f4-afae83a7ff04 None None] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:54:06.752717 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2828c36b4144b0098071053b9436388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:54:06.753339 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:54:06.753617 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:54:06.753890 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:54:06.756209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:54:06.866521 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:54:06.868261 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:54:06.890146 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1455/2886] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:54:09.530435 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:54:09.531984 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:54:09.543882 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f445-f82b-47f6-a46d-026a7c8a18c3 service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:54:09.547552 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:54:09.548177 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:54:09.548460 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:54:09.548736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:54:09.550440 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:54:09.564841 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:54:09.566288 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:54:09.577840 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1432/2887] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:54:16.887534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=66 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:19.572873 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=6 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:36.038167 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:54:36.040105 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:54:36.107663 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100943e-04af-47b2-b9cb-3a0ce06ad3ca service cinder] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:54:36.113159 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:54:36.113820 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:54:36.114097 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:54:36.114367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] PATH_INFO: `/v3/users/5f96ea7de0d74d2393afd458cb6ff74c` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:54:36.115683 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f96ea7de0d74d2393afd458cb6ff74c)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:54:36.117618 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:54:36.166514 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f96ea7de0d74d2393afd458cb6ff74c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.167168 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f96ea7de0d74d2393afd458cb6ff74c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.167808 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f96ea7de0d74d2393afd458cb6ff74c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.176741 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f96ea7de0d74d2393afd458cb6ff74c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.183754 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f96ea7de0d74d2393afd458cb6ff74c'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.203158 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1456/2888] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:54:36 2022] DELETE /identity/v3/users/5f96ea7de0d74d2393afd458cb6ff74c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:54:36.388453 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:54:36.403389 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f36ea-bc65-464c-afa2-b8079193a9ef service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:54:36.466111 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:54:36.466764 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:54:36.467047 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:54:36.467326 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] PATH_INFO: `/v3/projects/2508b437eb7248cc96db6094d6ee1bd8` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:54:36.468597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2508b437eb7248cc96db6094d6ee1bd8)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:54:36.470520 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:54:36.518220 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2508b437eb7248cc96db6094d6ee1bd8', 'request_id': 'req-c4193c22-1e6d-4beb-aced-26f00cc69ef3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.525248 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2508b437eb7248cc96db6094d6ee1bd8', 'request_id': 'req-c4193c22-1e6d-4beb-aced-26f00cc69ef3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.531120 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2508b437eb7248cc96db6094d6ee1bd8', 'request_id': 'req-c4193c22-1e6d-4beb-aced-26f00cc69ef3'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.544597 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] The token cache is being invalidate because project 2508b437eb7248cc96db6094d6ee1bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:54:36.544884 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.545533 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:54:36.547074 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1433/2889] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:54:36 2022] DELETE /identity/v3/projects/2508b437eb7248cc96db6094d6ee1bd8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 20:54:46.199556 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:46.541736 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:12.359231 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:12.361779 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:12.424367 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec300b-ad7b-43ca-9966-03a673f9610c admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:12.477518 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:12.478403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:12.478771 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:12.479114 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:12.482170 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:12.494347 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:12.495761 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:12.504337 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1457/2890] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:55:22.500586 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=46 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:27.924430 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:27.927071 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:28.020724 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4193c22-1e6d-4beb-aced-26f00cc69ef3 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:28.027092 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:28.027928 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:28.028268 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:28.029051 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:28.030961 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:28.047467 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:28.050466 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:28.066427 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1434/2891] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:55:30.499484 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:30.501219 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:30.520403 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1075a-8dad-4d10-8320-4e8c05d3daec service neutron] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:30.527826 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc303860598497f85766448bbdd7e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:30.529196 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:30.529574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:30.529832 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:30.532360 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:30.545840 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:30.547819 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:30.560491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1458/2892] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:55:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:55:38.060260 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=34 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:40.497155 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:40.498798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:40.515036 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3202-1922-4bfd-a970-7fb3538c2f80 service nova] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:40.519954 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a419e6d58c24957a62b648015ffaac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:40.521127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] REQUEST_METHOD: `GET` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:40.521469 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:40.521753 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:40.523608 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:40.556096 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=6 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:40.599263 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:40.600863 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:40.611060 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1435/2893] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:55:46.867144 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:46.869280 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:46.887400 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badec7f-4a72-4a45-82b8-4c490119f610 service nova] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:46.892188 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:46.892848 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:46.893133 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:46.893409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] PATH_INFO: `/v3/users/9b5ea50e80674c9f96821af04540ba39` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:46.894624 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5ea50e80674c9f96821af04540ba39)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:46.896825 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:46.951534 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5ea50e80674c9f96821af04540ba39'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:46.952198 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5ea50e80674c9f96821af04540ba39'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:46.952802 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5ea50e80674c9f96821af04540ba39'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:46.961591 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5ea50e80674c9f96821af04540ba39'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:46.974489 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5ea50e80674c9f96821af04540ba39'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:46.995912 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1459/2894] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:55:46 2022] DELETE /identity/v3/users/9b5ea50e80674c9f96821af04540ba39 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:55:47.181344 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:47.193798 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87d68-3b03-4af5-bc54-57ed1964e99a service neutron] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:47.257216 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:47.257846 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:47.258132 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:47.258412 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] PATH_INFO: `/v3/projects/c671352d2d2c475ab5c58932b6ecf5bc` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:47.259689 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c671352d2d2c475ab5c58932b6ecf5bc)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:47.261627 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:47.318575 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c671352d2d2c475ab5c58932b6ecf5bc', 'request_id': 'req-2f41e77b-6449-4673-9391-7465f07fa156'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.325828 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c671352d2d2c475ab5c58932b6ecf5bc', 'request_id': 'req-2f41e77b-6449-4673-9391-7465f07fa156'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.331990 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c671352d2d2c475ab5c58932b6ecf5bc', 'request_id': 'req-2f41e77b-6449-4673-9391-7465f07fa156'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.349652 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] The token cache is being invalidate because project c671352d2d2c475ab5c58932b6ecf5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:55:47.350037 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.351023 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.353543 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1436/2895] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:55:47 2022] DELETE /identity/v3/projects/c671352d2d2c475ab5c58932b6ecf5bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:55:47.358292 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:47.360657 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:47.377166 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1357-76c2-49a0-a7da-44fcf6c259b2 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:47.438523 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:47.439177 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:47.439491 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:47.439777 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] PATH_INFO: `/v3/users/a815f81cf9514b3d93963f2743aa28d7` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:47.441004 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a815f81cf9514b3d93963f2743aa28d7)` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:47.443594 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:47.493224 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a815f81cf9514b3d93963f2743aa28d7'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.493929 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a815f81cf9514b3d93963f2743aa28d7'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.494574 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a815f81cf9514b3d93963f2743aa28d7'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.503806 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a815f81cf9514b3d93963f2743aa28d7'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.511886 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.notifications [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a815f81cf9514b3d93963f2743aa28d7'} {{(pid=80438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.519454 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:47.530868 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1460/2896] 10.222.0.100 () {58 vars in 1229 bytes} [Fri Aug 5 20:55:47 2022] DELETE /identity/v3/users/a815f81cf9514b3d93963f2743aa28d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:55:47.732010 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Authenticating user token {{(pid=80437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:55:47.733548 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.fernet_utils [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:55:47.747546 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e77b-6449-4673-9391-7465f07fa156 admin admin] Validating token access rules against request {{(pid=80437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:55:47.769101 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:47.809264 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fbb9e763104d83ac22d69bcd83fff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb569dd63634bd9bd1193603cb21bb9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:55:47.810333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:55:47.810333 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:55:47.810566 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] PATH_INFO: `/v3/projects/434c8d1fa4584124a55a24da9063b260` {{(pid=80437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:55:47.811763 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434c8d1fa4584124a55a24da9063b260)` {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:55:47.813712 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] RBAC: Authorization granted {{(pid=80437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:55:47.862799 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434c8d1fa4584124a55a24da9063b260', 'request_id': 'req-ab565bdb-097d-4871-b2ee-1b1883115398'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.869505 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434c8d1fa4584124a55a24da9063b260', 'request_id': 'req-ab565bdb-097d-4871-b2ee-1b1883115398'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.876127 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434c8d1fa4584124a55a24da9063b260', 'request_id': 'req-ab565bdb-097d-4871-b2ee-1b1883115398'} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.893247 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] The token cache is being invalidate because project 434c8d1fa4584124a55a24da9063b260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 20:55:47.893474 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.894182 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG keystone.notifications [None req-ab565bdb-097d-4871-b2ee-1b1883115398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 20:55:47.896261 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: [pid: 80437|app: 0|req: 1437/2897] 10.222.0.100 () {58 vars in 1238 bytes} [Fri Aug 5 20:55:47 2022] DELETE /identity/v3/projects/434c8d1fa4584124a55a24da9063b260 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 20:55:57.530317 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:57.889574 dv-cinder-852208-3-iscsi devstack@keystone.service[80437]: DEBUG dbcounter [-] [80437] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:57:15.631671 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Authenticating user token {{(pid=80438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 20:57:15.633409 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:57:15.716449 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15591-c1dc-4179-878c-7735e7f06763 admin admin] Validating token access rules against request {{(pid=80438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 20:57:15.780043 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93ed5ec5662f4ca383b4c2e1653d150f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0b50b4e5b3646fe9cae583b51f6fb94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 20:57:15.780668 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] REQUEST_METHOD: `GET` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 20:57:15.780951 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] SCRIPT_NAME: `/identity` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 20:57:15.781230 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 20:57:15.783209 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.fernet_utils [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 20:57:15.794805 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 20:57:15.796447 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c6b6-f640-4472-9504-16e746dd2969 service placement] RBAC: Authorization granted {{(pid=80438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 20:57:15.806441 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: [pid: 80438|app: 0|req: 1461/2898] 10.222.0.100 () {60 vars in 1370 bytes} [Fri Aug 5 20:57:15 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 20:57:25.802302 dv-cinder-852208-3-iscsi devstack@keystone.service[80438]: DEBUG dbcounter [-] [80438] Writing DB stats keystone:SELECT=58 {{(pid=80438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}